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CHAPTER I 
INTRODUCTION 

Americans are bombarded almost daily by books,, magazines , 
newspapers, television, and radio on, tbe subject of the impend- 
ing crisis in extending our educational resources to cope with 
expanding and changing education and technology. Tne crisis 
and its special implications, for higher education have been 
documented by the. American Council on Education (Venn, 1964). 

The curriculum development, research, and dissemination activi- 
ties undertaken in the present project represented an explora- 
tion of one technological advancement which holds promise for 
alleviating a portion of this educational crisis. 

Our total educational effort in the United States is faced 
with a number of major challenges. One of these comes from 
the school population explosion at all educational levels,. which 
has resulted in a nationwide shortage of teachers and instruc- 
tional facilities. The indications are that this inadequacy 
is likel> to persist, for some years. However, the problem is 
more difficult than the mere expansion of present educational 
effort. A major problem is associated with the change in the 
job that schools and colleges are being asked to perform for 
society; changes in the society itself, which educational insti- 
tutions serve, are increasingly dramatic and complex, the situa 
tion may be summarized by saying that at a time when all facets 
of the educational enterprise are increasing at the greatest 



rate In all history, it Is at the sane time expanding the breadth, 
the depth, and the scope of education. 

In attacking the problems of education, the first encoun- 
tered difficulty that the total resources available for educa- 
tional development are quite limited relative to the magnitude 

of the task to be undertaken. Thus, it is necessary to accept 

« • 

progress toward these goals as less than would be desired under 
Ideal conditions, and to recognize priorities of greatest impor- 
tance' as primary tasks. The difficulties go well beyond the 
mere resource allotment in a monetary sense. In order to get a 
feeling for the extent to which this is true, it is well to 
consider the nature of ideals which are becoming generally ac- 
cepted for future public education in this country: 1) the 

length and scope of education freely available to each person 
in the entire population are to be extended as soon as feasible 
to encompass all of the education that will benefit a person;^ 

2) no significant fraction of the population should receive an 
education which can be regarded as being of poor quality; 3) 
education is a major process continuing throughout the life of 
the individual . 

if ofse considers these ideals as goals, it becomes appar- 
ent that there are greater impediments to attaining some of 

^Cfv Policy Statement on education issued by President 
Johnson on November 4, 1964. “. . . every child has the right 

to as much education as he has the ability to receive. I 
believe that this right does not end in the lower schools, but 
goes on through technical and higher education, if the child 
wants it and can use it . . . .“ 
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them than the difficulty of obtaining the very substantial eco- 
nomic resources required. As a nation we can no longer afford 
the luxury of merely trying to do more of what we have been 
doing In the past. Thus, the decision to Increase significantly 
the content of education at all levels has very far-reaching . 
Implications for the In-service education of teachers. 

Perhaps the greatest difficulties of all do not arise 
directly from the requirements being placed on educational insti- 
tutions, but stem from changes In the character of society It- 
self. Surely, the most Important single socio-economic phenomenon 
of the present era Is the rapid shift from an economy based on 
limited-skill labor to one which rests on Intelligent personal 
service of an Increasingly technical nature. Moreover, at a 
time when jobs are becomiAg Increasingly technical , it is also 
true that the technical c ClHpS tence required of workerj Is chang- 
ing at an accelerating rate. In many, vocational and professional 
areas today, the rapidity of technical and scientific advance 
has become so great that It Is literally Impossible to create 
academic curricula which are not obsolete at the time of their 
Inception. 

In a sense, the problem of the rapid obsolescence of cur- 
ricula arises whenever the period of significant technological 
change Is comparable to, or shorter than, the period required to 
train the majority of those who must teach the material. The 
accelerating pace of technological development Implies that such 
conditions are going to become more and more general until they 
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Impact education across the board. It follows then that the 
methodology of education, the concepts of teacher education, 
and the general structure of education must undergo significant 
and drastic changes In the near future, indeed, the greatly 
Increased educational requirements, the correspondingly longer 
training periods needed to attain a given level of proficiency, 
and the ever-changing character of subject matter already are 
Imposing great burdens on existing efforts in education and 
are creating an Impetus for change in the methodology and struc 



ture of instruct I ofidll processes. 

Clearly, new methodologies and techniques of education are 

of great Importance where they seem capable of overcoming these 
fundamental difficulties. The technical approach which has been 
the focus of this Investigation may be described as computer- 
assisted, tsacfcer-supervlsed, self-study, and hereafter referred 
to .. rnmnuter-assisted instruction (CAI). There were a number 
of reasons to suggest that this approach right be fruitful: 

1) potentially, it permits an efficient use of expensively and 
highly educated teachers, and thus a substantial Increase In the 
student-to-teacher ratio; and 2) at the same time. It makes 
possible an acceleration and individualization of Instruction to 
an extent which has often been dreamed In theory, but rarely 



achieved in educational practice. 

Specifically; the objectives of the project were as follows 
1. To determine the feasibility of using college teachers 
with limited knowledge of digital computer systems and computer 
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progranmiing to prepare various subject matters for presentation 
by a computer. The teachers were aided in the preparation of 



these materials by the use of a special computer language devel- 
oped especially for teacher-authors. This language* known as 
Soursewrtter^ ..al lows an author to program the computer to pre- 
sent materials on the basis of the students* jr®sponses by the 
use, of a number of logical commands. One purpose of the project 
was to suggest improvements in the author language on the basis 
of actual author experiences. An anticipated outcome of the 
project was a more efficient special computer language for course 
writing by teachers. In addition* the feasibility of teaching 
several different subjects simultaneously by means of the computer 
was an important part of this objective. 

X. A second etjsctlve was to ascertain the reactions of 
students to the. course materials presented by a computer. Authors 
were encouraged to try out alternative teaching strategies in 
CAI so that preliminary evidence could be obtained to determine 
which methods of presentation would be most acceptable to the 
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assisted Instruction* using sections of courses instead of full 



length courses* and which involved 67 college students was made; 
these data are reported in Chapter VII I. During the spring term 
and summer term* 1966* at Penn State* field trials were then 
conducted for each of four college courses. 

3. A third objective was to make corapari sons of the effec- 



tiveness of computer presentation of course materials with the 
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lectufG-dlscusslon method. Ho systematic comparisons of CAI and 
conventional lecture presentation were made; however* some In* 
formal comparisons were undertaken to help evaluate the quality 
of the CAI materials. The Investigators associated with this 
project question the value of comparing teaching methods. Rather 
than attempting to "reject the null hypothesis" with regard to 
comparisons of CAI with traditional Instruction, It was expected 
that such comparisons would help Improve existing course mater- 
ials and help Identify a rationale for Integrating sections of 
CAI courses with existing curricula. If CAI Is to be an Impor- 
tant educational medium In the future, the situations In which 
Its use Is most desirable and the methods for best Integrating 
It Into the general educational process must be quickly Identified. 
The experiences of the teacher-authors reported In a later sec- 
tion of this report bear on the above question. 

4. A fourth objective was to provide demonstrations of a 
functioning prototype of a computer-assisted Instructional sys- 
tem which could be expanded to provide service to an entire 
school or group of schools. Dissemination of Information Is a 
serious problem In educational research. By means of live "hands 
on" demonstrations, video tape recordings of students working 
with CAI, and a short Introductory color film the Investigators 
hoped to make some Inroads Into the problem of dissemination. 

5. A fifth objective of the project was to determine the 
feasibility of a computer-assisted Instructional system In which 
course material and student responses are teleprocessed over 
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some distance between teaching terminals and a centrally located 
co?rtputer. While the chief purpose In teleprocessing in the 
present project was to eliminate tha need for an expensive com- 
puter system and programming support, there are educational 
situations In which remote Instructional terminals might be the 
most desirable feature of a CAI system. One such application 
would be a continuing education program, such as updating the 
training of graduate engineers. Another application Is the 
In-service education of public school teachers. 

6. The sixth and final objective was to develop CAI cur- 
ricula of sufficiently high quality to be used In later research 
studies with actual college and high school students. While 
the primary purposes of the Investigation were the five listed 
above, CAI offers many opportunities for research on problems 
of complex human learning and Instruction. A computer-controlled 
Instruction system offers opportunities for carefully manipulated 
presentation of verbal and visual stimuli (Instructional mate- 
rials) rarely possible in previous research on Instruction. The 
courses were developed In such a manner that they are readily 
arnendble to experimental manipulations and research on student 
learning. A number of Investigations have been proposed, and 
the results of several pilot Investigations are reported In 
Chapter VIII of this report. 




CHAPTER II 

DESCRIPTION OF THE COMPUTER-ASSISTED INSTRUCTIONAL - 
SYSTEM AND RELATED LITERATUREl 



Computer-assisted instruction may be thought of as a way 
to enhance the effectiveness of teachers and the teaching pro- 
cess through technology. In the piistt devices such as motion 
pictures^ filmstrips* workbooks# and language laboratories have 
been incorporated into educational practice to facilitate and 
extend learning; generally, these devices have been used to 
automate traditional methods of teaching and hot necessarily 



to make learning more functional. Regardless of the device, 
the general approach here has been to maintain the traditional 
method of teacher-mediated group instruction in the more or 
less conventional classroom situation. The conception of CAI 
which has guided our work has been to supplement rather than 
supplant the teacher in the classroom. 

The publication of Skinner* s Science paper in 1954 set 
forth an alternative approach to the achievement of educational 
goals. Programed instruction specified desirable terminal be= 
haviors and used the principles of a learning theory to estab- 
lish a means of attaining these behaviors. The instructional 
sequences in Skinner's plan were individualized in linear pro- 
grams through self-pacing, or more recently in branching programs 



Vhe investigators are indebted to Dr. E. N. Adams for the 
basic analysis of the field as contained in this chapter. 
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hrough the vormulation of different sequences on the basis of 

student's last response. Early in the movement, machines were 
abricated to present these pro 9 »*amed materials; however, it 
as found in most cases that the use of hardware did not enhance 
earning over the use of the same materials in text form (Goldstein 

Gotkir, 1962). 

Research and development involving the use of a cowp'iter 
0 assist in the instructional process may be thought of as 
eing related to teaching machine technology; but, CAI, because 
f its flexibility, decision logic characteristics, and sophis- 
ication of input-output modes, must be considered as a quantum 
idvance (at least in theory) over traditional programed instruc- 
ion. Projects using a computer for instruction are similar to 
•ach other but differ in their emphasis. The flexibility of the 
ligital computer allows for a variety of themes different from 
md richer than the themes of programed instruction as repre- 
»ented in the programed text or simple teaching machine. One 
iuch theme has been the use of soDhisticated inpuj. and outpu t 
lisplavs to facilitate communication between the student and 
the system, e.g., cathode ray tube display, various large capacity 
random-access visual and audio devices, special response keyboards, 
ind light pens. These devices are particularly attractive to 
the psychologist Interested In research, but at the same time 
do not stimulate similar research in other laboratories because 
the equipment used is generally cf experimental or prototype 
construction and is extremely expensive. Two. efforts that 




emphasize this theme In computer teaching are those of Bitzer 
(1962« 1964) and Suppes (1964). 

A second theme has been to adapt course organization to 
the individual student's needs . Here the concept Is to monitor 
and analyze student performance; and, on the basis of this per- 
formance plus other historical Information about the Individual 
student, continually adjust the course organization to optimize 
It for a particular student's progress. Such tailoring of mate- 
rials to an individual student Is highly desirable but of relative 
high cost because considerable computer capability Is needed for 
each student. To some extent, this has been the approach taken 
by Stolurow (1963) and Smallwood (1962). 

A third theme has been that of tutorial Interaction . The 
concept here Is that the high-speed logic of the computing ma- 
chine reacts to the detailed features of student performance 
on specific tasks, records the efforts of the student In dealing 
with these tasks, and presents appropriate remedial or accelera- 
ted action where the student Is not succeeding or Is Insuffl^ 
clently challenged. The tutorial Interaction Is supplementary 
to the strategic job of adjusting the arrangement and difficulty 
of the tasks and their manner of presentation to the Individual 
student. This approach was exemplified by the early effort at 
the IBM Research Center (Uttal, 1961, 1962), and haS been charac- 
teristic of the CAl curriculum materials developed at Penn State, 
Florida State, University of California at Irvine, and other 
pioneering Institutions. 
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A fourth theme has been the process of simulation and gam> 
ing interaction between the student and the machine* Here the 
role of the machine is that of simulator of a process or as an 
opponent with which the student interacts just as he interacts 
with'process or persons In laboratories or real situations. 

This theme is prominent in the work at Bolt, Beranek and Newman, 
Inc., (Swets, 1962) and Wing (1966) at the Board of Cooperative 
educational Services, Westchester County (N. Y.) Public Schools. 

In addition to the above studies, the reader may find the 
reviews by Dick (1965) and Gentile (1966) helpful in providing 
additional background in the development and status of computer- 
assisted instruction. 

The present investigation of computer-assisted instruction 
emphasized tutorial interaction and made limited usage of the 
other themes deiscribed. The writers believe that each of the 
emphases described above represents a valid conception of an 
approach to the use of computers as educational aids, but that 
the tutorial approach may be practical for many instructional 
purposes. Current and projected needs forced the investigators 
to consider computer instructional cost, both for the develop- 
ment of courses and the administration of these courses by the 
computer in “production" teaching. The investigation sought 
to establish a flexible Interface between the learner and the 
computer, but at the same time to utilize a system that would 
be justifiably economical in the long run to allow for wide- 
scale adaptation to a variety of educational operations. 





Because of the high cost of computer systems for direct 
teaching, a number of educational developers have turned to the 
employment of the computer as an aid In the management of In- 
struction. Under this concept, each school or Instructional 
sub-unit Is provided with a terminal connected to a central 
computer. Input consists of Information about each pupil's 
progress on separate Identifiable elements of "off-line" cur- 
riculum material. Output at the terminal consists of a set of 
diagnostic Instructions directed to the teacher for managing 
the education of each child. This new "systems" approach or 
computer-management Instructions bears the same relationship to 
CAI that remote batch processing bears to time-shared conversa- 
tional Interaction In conventional computer terminology. !t 
remains to be seen which approach will be the most readily 
accepted by the education community. 

The main outcome of the present project was the development 
of four college courses for presentation via CAI. Unlike most 

f 

developmental projects In CAI, the present project was not con- 
cerned with the Invention of terminal hardware or the writing 
of computer programs In machine language. These tasks have been 
avoided by using a commercially available typewriter terminal 
as the Interface between the computer and the student, and the 
CourseWrIter language (Appendix A.l) developed at the IBM 
Thomas 0. Watson Research Center for controlling this Inter- 
change. Virtually all of the efforts of the project have been 
devoted to the preparation of educational materials to be pre- 
sented by a computer. 
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The Couysewrl ter language enables an authors with a mini- 
mum of special training* to include questions* problems'* assign- 
ments* correct answers* incorrect answers* provisions for unan- 
ticipated answers* knowledge of results* and branches or alter- 
ations in the sequence of a course. In addition* an author 
can employ a process of record keeping known as Student Record, 
which will record and accumulate in storage all student responses 
and response times. This latter feature is useful to authors 
for the purpose of analyzing and improving the course content* 
for revising trial versions of a course* and as a basis for 
counseling and advising students who use the course material. 
Additional operations in Coursewriter can call for the presen- 
tation of visual material stored on 2 x 2-inch slides or audio 
material stored on magnetic tape at the student *s t®^***^i*®V* 

This presentation is mediated by a computer-controlled random- 
access slide projector and random-access tape recorder. During 
the development of course materials* new functions were period- 
ically added to Coursewriter which were then implemented into 
each course. Among these additions* for example* were functions 
which allow flexibility in matching stored answers* i.e.* func- 
tions which command the computer to ignore trivial characters 
such as commas* periods* spaces* differences in word order* 
and misspelling if desired. A more detailed description of the 
operation codes used with the Coursewriter language is given in 
Appendix A.l . 
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The computer system employed in the early phases of this 
investigation was an IBM 7010 (compatible with the IBM 1410), 
with remote IBM 1050 typewriter terminals. The main computer 
was located at the IBM Thomas J. Watson Research Center in 
Yorktown Heights, N. Y., while the typewriter terminals were 
located in Chambers Building on the campus of The Pennsylvania 
State University. Ir. March, 1966, computer service was initiated 
from the Penn State Computation Center to service two terminals 
for CAI. Oataphones and telephone lines were used for trans- 
mitting information between the Chambers Bui Iding ^terminals and 
the central computer. The student terminal configuration was an 
IBM 1050 instructional terminal which included a modified IBM 
Selectric typewriter and which permitted two-way communication 
between a student in Chambers Building and the computer at 
Yorktown Heights (or more recently the IBM 1410 at Penn State's 
Computation Center); a random-access slide projector; and a random- 
access tape recorder -- all components unSer computer control 
and activated by a set of instructions stored in the central 
processor. Course material can be presented to a student by 
typeouts, slides, or tape recordings. In answering a question 
or problem, the student types his answer at the terminal and 
relays it to the central computer. The computer then provides 
knowledge of results to the student, remedial information, or 
the next problem. 

In addition to the student instruction mode, the type- 
writer terminal can also be used in "author mode' for input of 
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course material, revision of course material, or for author 
testing of course material. The course Input Is transmitted 
to the computer where It Is stored on high-speed magnetic discs 
to which the computer has selective access to any part. In 
addition to “on-line" Input of course materials, the use of 
an IBM 1058 card punch attached to a typewriter terminal per- 
mits off-line Coursewriting on IBM cards. The cards can then 
be transferred to the central computer and Input for disc or 
tape storage. The latter procedure frees more on-line terminal 
time for student instruction. 
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CHAPTER III 

PREPARING COURSES FOR COMPUTER PRESENTATION , 

As previously mentioned, courses have been prepared for 
presentation via computer by means of a language known as 
Coursewriter « Although a complete description of the language , 
is beyond the scope of this report, a summary of the functions 
of each of the operation codes is given in Appendix A. 1* A 
manual emphasizing the application of Coursewriter language 
to instructional strategies is in preparation a^ an extension 
of the current Penn State program. 

The list of operation codes taken from thtj IBM Coursewriter 
manual (196E), although not exhaustive, covers most of the basic 
operations in the language. A reproduction of a course as it 
is stored in the computer is shown in Fig. 1. Each operation 
code has an accompanying sequence number which is used to identify 
and sequence the course material. In preparing a program for 
the computer, the author prefaces segments of the course with 
the appropriate operation codes. The operation code indicates 
to the computer how the argument of that operation code is to 
be used. For example, the entry for a question consists of a 
qu followed by the text (argument). The gu. code instructs the 
computer to type the question (argument) on the terminal and to 
wait for the student to respond. 



r 
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Sequence No. 


Label 


op. Code 


Arqument 


aa-0010-0T0 


intro 


qu 


3 + 2 » 


aa-0010'020 




ca 


5 


aa-OO'fO-030 


* 


ty 


correct 


aa-0010-040 




wa 


6 


aa-0010-050 

« , i * ' 


^ X- ^ i , * 


ty 


You multiplied instead 
of adding. Try again. 



Fig. 1. Reproduction of a Typical CAI Course Segment 



The aoount of material stored for any given sequence number 
(usually referred to as a “statement”) is dependent upon the 
operation code used. There is no limit to the amount of material 
which can be stored in the argument of a j^» g]i» ty., or un state- 
ment. If the statement is a ca, d^, wa, or wb, the argument 
is limited to 99 characters. Any letter, space, upshift, down- 
shift, or any other single-key operation on the typewriter termi- 
nal is counted as one character. 

The label is an identifiable name selected by an author 
for any statement in a course. The label provides a meaningful 
symbol which can be branched to by using a ^ statement. 

One major objective of the present project was to test 
the feasibility of having college faculty members with minimal 
computer experience prepare courses for computer-assisted instruc 
tion. College level courses were prepared in four subject mat- 
ter areas: audiology, modern mathematics, management accounting, 

and engineering economics. Table 3.1 provides a summary of the 
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coursfi Tndterials compIstGd iR the four course erees es of 
December 35, 5966. The values in this table represent the final 
content of the course and include no indication of the number 
of statements revised or rewritten. 

Table 3.1 

Summary of CAI Programs Completed 
for Four College Courses 





December 31 , 


1966 






Course 


No. of 

Coursewriter 

Statements 


No. of 
Slides 


No. of 
Tape 

Fie corded 
Messages 


No. of 
Static 
Displays 


Audiology 

Management Accounting 
Modern Mathematics 
Engineering Economics 


8,145 

6,556 

11,765 

4,104 


197 

67 

258 

5 


127 

34 

138 

7 


33 

23 

61 


TOTAL 


30,570 


527 


306 


117 



Considerable variability exists in the programing strate- 
gies used by the authors. This variability seems to be a func- 
tion of differences in course content, the ease of programing 
different courses for the computer, and the authors' teachini 
preferences. One author used primarily an Inductive approach 
in which examples and problems are illustrated followed by ques 
tions designed to help the student discover the principle in- 
volved. Several authors employed a large number of branches 
to remedial or explanatory material, while others presented 
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expURatory material in the wiaiR trunk of their program. Some 
authors used a liberal number, of prompts or hints to elicit 
student resp^nsest while others required the student to do more 
independent searching for correct answers. Differences also 
exist in the kinds of questions that have been used (multiple 
choicet single word completioOf true-false, multiple word con- 
structed response) and in the quantity and quality of knowledge 
of results, feedback, and reinforcement. These “built in’* dif- 
ferences among and within courses have provided useful materials 
for future experimental tests of the effectiveness of the differ- 
ent methods of presentation. 

Our experience with programing different courses suggests 
that although most subject matters can be taught feasibly via 
CAI, some are especially well suited for computer-assisted in- 
struction. For example, the presentation of visual and auditory 
materials via the slide projector and tape recorder would seem 
to be particularly effective when they provide nonredundant 
information to the learner. Simply presenting material on slides 
and tapes which can be presented as well by a printed display 
to the student holds no great advantdvge for learning other than 
whatever advantages accrue from repeating the communication in 
the different sensory modalities. In many courses, however, in- 
formation can be conveyed by slides and/or tape recordings which 

I » ' ' ' ' ' ' ' 

would be difficult to transmit to the learner by other means. 
Slides were developed for the audiology course which portray 
various parts of the human auditory system. The slides were 
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developtd in a manner siiniUr to overlays for overhead projec- 
tion -- emphasisinp one section at a time until an entire ana- 
tomical system is displayed. Another particularly interesting 
use of the tape recorder was used in the au?11ology course. 

Correct pronunciation of anatomical terms were played for the 
students whose job it was to learn proper pronunciation of a 

difficult vocabulary as well as correct anatomical location. 

' - ^ , * ' 

Training CM Course Authors. 

The present project was one of the first to implement the 
preparation of course materials for CAI using the Coursewriter 
language and teleprocessing from remote terminals. For this 
reason, problems were encountered early in the project which 
can now be avoided in future CAI projects. Although several 
short training workshops were held for the project staff by 
IBM personnel, it is fair to say that most of the project staff 
were largely self-taught. It is hoped that our early experience 
with CAI will be of some help to other investigators who plan 
to cJo work in this area. 

Although Coursewri ter is a relatively simple language to 
use when compared to other more traditional computer languages 
such as Fortran, Daft, Algol, and Autocoder, considerable time 
was spent during the first few months of the project learning 
to use the language. In the judgment of the investigators, 

i 

training authors in a more systematic fashion by means of a 
two- or three-week workshop to provide supervised coursewriting 



ex})er1ence would be superior to the tr1a1-and-*error training 
necessitated In the present project. The tralrilng of authors 
In the early stages of the project was hampered by several prob- 
lems: 1) the CAI hardware Itself had only been recently In- 

stalled and debugging was being completed; Z) the Coursewriter 
language was In the process of being written and revised, and 
thus was changing from week to week; and 3) authors were faced 
with the more difficult problem of fully utilizing the Instruc- 
tional potential of CAI. As more experience was gained with 
computer-assisted teaching systems, problems of author training 
were minimized. 

Aside from learning the Coursewriter operations , the most 
difficult problem facing a potential author of courses In CAI 
Is that of utilizing the dynamic properties of CAI. Preparing 
materials for CAI Is very different from preparing materials 
for a traditional lecture class of 40 or 50 students. Most 
traditional lectur<?ss, like earlier forms of programed Instruc- 
tion, Involve linear teaching strategies. To conceive and de- 
velop a course^ which will adapt to the abilities and Interests 
of any learner In a population of learners exhibiting wide Indi- 
vidual differences, requires skills which have frequently not 
been acquired by many teachers or professors, nor have they 
of ter been taught In teacher education curriculums. The most 
likely reason for the neglect of these skills for Individualizing 
Instruction Is the great complexity which they Introduce Into 
the design of teaching strategies and Instructional materials. 
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Within the domain of adaptive CAI, one can conceive of mwltiple 
track and hierarchical instructional strategies. A number of 
the authors developed flow charts of their courses prior to 
the actual production of the course. Flow charting has the 
advantage of forcing an author to state his objectives prior 
to course development, and to graphically indicate various 
routes through the course by which students of different abili- 
ties and interests can reach the course objectives^ 

The use of adaptive CAI also involves some assumptions 
about the nature of student learning which are frequently either 
unaccepted or ignored in traditional teaching situations. The 
use of adaptive t^iiiching systems assumes that the variability 
in attainment of learning objectives among different learners 
can be substantially reduced. Although some psychologists find 
evidence for a genetic limit in a student's learning ability, 
recent evidence points to the great malleability of such varia- 
bles as measured intelligence and school learning. One of the 
most striking early findings of the present investigation (more 
fully reported in Chapter VIII) was the great spread of cri^ 
terion test performance among college students on CAI courses 
specifically designed to include remedial work and adaptation 
to individual differences. In one section of modern mathematics 
containing approximately fifty per cent remedial work given 
to students having difficulty in the main course, criterion 
" achievement test scores ranged from 5 to 23 on. a 23 item test. 

The reader should note that these were a select sample of 
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college students having generally high mean academic aptitude 
test scores and short range. Such widespread variability In 
achievement found among these students can only stem from a 
failure of the Instructional strategy. One of the most valuable 
attributes of computer- assisted Instruction for training Instruc- 
tional programers Is the ease with which authors obtain feed- 
back concerning the adequacy of their courses. In the normal 
classroom situation, feedback concerning one's teaching pro- 
cedures Is frequently delayed too long for the feedback to be 
relevant. In CAI, feedback concerning one's course can be ob- 
tained almost Immediately by signing on as an author-student 
to test the course. Rarely does the classroom teacher have 
an opportunity to "sit In the student's shoes"; however, such 
experience Is thd rule rather than the exception In CAI. In 
addition to having firsthand experience as a student on one's 
own course. Information concerning the performance of regular 
students Is readily available. Such students have been used 
to provide Information to help diagnose the strengths and weak- 
nesses of a course. 

Capabilities for rapid revision are required of an Instruc- 
tional system If feedback concerning the adequacy of Instruction 
Is to lead to Improvements In the course. One of the major 
advantages of CAI Is Its potential for rapid revision of course 
materials. Depending on previous schedul ng of computer time, 
revisions can be made within several days. This Is a particularly 
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Important characteristic since the preparation of course material 
frequently requires considerable revision to i»mooth out minor 
defects* 

Preliminary results concerning the Incidence of mechanical 
malfunctions with the basic typewriter Input-output terminal 
have been highly encouraging, esDe^^*^J in view of the complex 
electronic system Involved. One objective of the project was 
to test the feasibility of teleprocessing course material to 
remote Instructional terminals. A check of a sample of 10*374 
statements of program completed by a small sample of students 
showed that transmission errors occurred In only 0.2 per cent 
of the statements. On the basis of these preliminary results, 
we can conclude with some certainty that computer-assisted In- 
struction at remote terminals via teleprocessing Is surpris- 
ingly free of mechanical malfunctions. 

Field Trial 

One of the major results of the project was the develop- 
ment of four operating CAI courses. During the spring term 
of 1966, a field study was conducted using three of the courses - 
Speech Pathology and Audiology, Introductory Management Account- 
ing* and Modern Mathematics. Engineering Economics was field 
tested during the summer term of 1966 at Penn State University. 

_In order tc provide. the students with the best educational 
experience possible, a general methodology was used for all of 
the field trials even though there were minor variations within 
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each course* Each of the courses was a three-credit course 
which normally meets three periods (75 minutes each) a week 
for 10 consecutive weekSo Each class participating in the field 
trial was divided into three groups. Group 1 was in attendance 
at all class meetings with the professor; this group was identi- 
fied as the lecture group. Group 2 was in attendance at one 



class meeting at the beginning of the week; two class meetings 
(eguivalent time) were spent at the teaching terminal in the 
CAI laboratory. This group was identified as the GAI group. 
Group 3 was in attendance at one class meeting rt the beginning 
of the week; and two class meetings (equivalent time) were spent 
in the Curriculum Materials Center In the College of Education. 
This group was identified as the self-study group. 

CAI Group . The CAI Laboratory Staff scheduled students 
according to time available on terminals and individual sched- 
ules for no less than a total of two and one-half hours per 
week. Students could, of course, spend more or less time as 
required by their work habits and assignments. The Laboratory 



staff provided such materials as handouts, models, reference 
books, colored pencils, slides, and tapes necessary for the 
students to use as they progressed through the course. A proc- 
tor from the staff of the Laboratory was available at all times 



when students were scheduled on terminal. The professor of 
each course was provided with a carbon copy of each student’s 
printout from the terminal, and the student retained one copy 
for review purposes. 
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Self-Study Group > Students were scheduled at the Curricu- 
lum Materials Center for two and one-half hours per week accord- 
ing to their Individual schedules. The Curriculum Materials 
Center Is a library-type facility equipped with Individual study 
carrels where specific references may be placed for student use. 
Maierlais such as har.douts, sets of 

slides, and slide projectors were provided In the Curriculum 
Materials Center for the students’ use. A proctor was available 
at all scheduled times to distribute materials as requested by 
the students, and to record the amount of time spent by each 
student using self-study materials. 

Chapters four, five, six and seven of this report present 
the details of the course development and field study for each 
of the four courses developed for CAI. 
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CHAPTER IV 

INTRODUCTION TO AUDIOLOGY ' 

(Bruce M. Slegenthaler and Jeffrey Katzer--Courie Authors) 



“Introduction to Audiology" (Speech Pathology andAudiblogy 
430, 3 credits) is the first course in audiology at Penn State 
and is normally taken during the junior yiar of undergraduate' 
study. 



The objectives of this course include the following: 
1. Introductory survey of the field of 



Development of a knowledge of technical 
terms used in audiology; 

3. Classification of information regarding 
the anatomy and physiology of the normal 
ear and of ear diseases at a survey level; 

4. Understanding of general principles of' 
testing hearing and deyelopment of skill 
in administering pure tone air conduction 
tests and their interpretation; 

5. Survey of rehabilitation measures for 
hearing handicapped. 

Although the course i* required during the junior year of 
the undergraduate SPA (Spev. ;:i £,athology and Audiology) cur- 
riculum and the major enrollment is by these students, the 
course is also taken by a number of graduate students in the 
master's program in SPA and by students from outside SPA who 
minor in this field. 
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During the winter term, 1965, a small-scale evaluation of 
CAI as applied to SPA 430 was completed. Of the 25 students 
enrolled In the class, 12 volunteered to participate In CAI as 
a supplement to class attendance. These 12 volunteers were 
randomly divided Into two groups, one to receive CAI and the 



other not. All students other than the 12 volunteers attended 



three lectures each week 
on the computer terminal 



However, six CAI studepts spent time 
tv csinplete ths ssaterisi or. anstcssy 



and physiology of the ear. At the end of the first third of 
the course (when the work on anatomy and physiology was com- 
pleted), a comprehensive test on that material was administered 
to all students. These data were analyzed for the three groups: 
1) students who had not volunteered for CAI, 2) students who 
volunteered for CAl but who were Included by the random pro- 
cess* and 3) students who volunteered for CAI and were selected. 

F:)r Group 3, i comparison was also made of those questions sup- 
plemented by CAI and those questions not supplemented by CAI, 

The results, based upon a very small sample as cited above, 
did not Indicate a clear-cut advantage for the students receiving 
CAI either for the CAI-related questions or for the non-CAI re- 
lated questions. However, It must be remembered that all stu- 
dents attended all lecture sessions and therefore all received 

the same instruction via lectures. 

Subjective evaluations of the computer program by students 
were highly enthusiastic. Some of them were able to complete 
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all of the program material In as little as two hours of termi- 
na1 time, while others required about six hours. Those who 
experienced CAI felt they had benefited by the Instruction 
(although their scores did not clearly Indicate this), and all 
of them expressed a high level of Interest and motivation to 
continue with additional CAI activities, 

' '»> ' \ ’ f ' ' ’ ' . 

Field Trial 

A field trial of the CAI speech pathology and audiology - 
course was conducted during the spring term, 1966. The purposes 
of this study were twofold; 1) to Investigate the problems In- 
volved with providing CAI experience for a number of students 
on a regular basts for academic credit, and 2) to obtain and 
analyze data fqr Improving the CAI course based on student re- 
sponses and reactions. 

Random Assignment of Students . The 21 students who enrolled 
In the speech pathology and audiology course were stratified 
Into ^hree levels on the basis of Scholastic Aptitude Test 
scores. The students In each of the stratified groups were then 
randomly assigned to one of the field study conditions - self- 
study, CAI, or lecture. 

Lecture Group . The seven students assigned to the lecture 
group met with the professor three periods (75 minutes each) 
weekly. This segment of the class group was taught according 
to the standard procedures used by the professor for a lecture- 
discussion class. 
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Self-Study Gro up. Seven students were assigned to the self- 
study group. These students met In the lecture group one period 
each week with the professor and were assigned to the Curriculum 
Materials Center, located In the College of Education, for two 
periods each week. Appendix D.l Includes a sample of the self- 
study guides available to each student. Appendix 0.2 Is a list 
of the anatomical slides which were also available with a pro- 
jector In the Curriculum Materials Center for the students to 
use. Table 4.1 Indicates the amount of time spent In the Cur- 
riculum Materials Center by each student who was assigned to 
the self-study group. The students were not Informed that a 
record was being made of the amount of timve they spent In the 
Center, nor was this time used to evaluate students In any way. 
It merely Indicates that some students spe:it considerably more 
time using the specific references placed In the Center. 

CAI Group . Seven students were assigned to the CAI group. 
These students met with the professor and the other two groups 
one period each week and were assigned time on the CAI terminal 
for approximately two periods each week. Appendix D.3 contains 
a sample of the speech pathology and audiology CAI program which 
Includes slide and tape recorded messages. Appendix D.4 Is a 
flow chart and Interpretive notes for the first part of the pro- 
gram. Appendix 0.5 contains samples of the static displays', 
and Appendix 0.6 contains samples of the student handouts pre- 
pared for use with the course. 
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Table 4,E shows the structure and amount of course material 
stored in the computer. The course is segmented into chapters 
for sase of handling at the Computation Center; however* a stu- 

' i 

dent taking the course continues directly from one chapter to 
the next if he so desires. 



Table 4.2 

Structure of CAl' Speech Pathology 
and Audi oTociv Course 
as of December 1966 



Chapters 


No. of 
Coursewrlter 

Instructions 

} 


No. of 
Questions 


No. of 
Slides 


NOc of 
Tape 

Recorded 

Messages 


No. of 
Stati c 
Displays 


: "i ' 


1932 


107 


25 


47 


3 


2 


841 


57 


9 


1 1 


4 


3 


464 


18 


6 ‘ 


13 


2 


4 


910 


56 


15 


14 


4 


5 


593 


27 


23 


11 


5 


6 


440 


16 


17 


23 . 


1 


7 


325 


8 


1? 


1 


■ 1 


8 


402 


8 


13 


:i 


2 


9 


517 


26 


■= 6 ’ ' 


1 


1 


JO 




17 


7 


1 


2 


11 


555 


26 


11 


1 


A 




362 


11 


12 


1 


2 


13 


391 


10 ■ 


/ 36 '' 


2 


2 


Total 


81^5 


387 


197 


127 


33 
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Table 4.3 shows the time s^^ent on computer terminal by the 
students in the speech pathology and audiology CAI group. 



Table 4.3 

Time Spent on Instructional Computer Terminal by Students 
in the Speech Pathology and Audiology CAI Group 

Field Trial, Spring 1966 



student 

Number 


Oates 

Beginning-Ending 

1966 


Time 

Hours-Winutes 


Average . 
Hours/Week® 
Hours-Minutes 


7577 


4/25 - 5/23 


17 


50 


3 


34 


7579 


4/25 - 5/n 


14 


45 


2 


57 


7580 


4/25 - 5/19 


11 


49 


2 


27 


7581 


4/27 - 5/24 


19 


24 


3 

] ^ 5 


53 


Total Time 


- 63 hours and 48 


minutes 






\ t ' ' 


Average time per student - 15 


hours 


and 57 minutes 




^ ‘ 



^Calculated on the basis of maximum number of weeks (five) 
on terminal by student from the group. 



Table 4.4 shows the character and operand code count for 
five representative selected questions from the course. On the 
basis of the information from these five questions, it is esti- 
mated that for the 387 questions and related instructions in 
the course there are approximately 546,300 characters in com- 
pute^ storage for the 13 chapters. 

The entire question frame for each of the sample questions 
is presented on the foil ^ing pages. Following each question is 

O 

ERIC 
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* 

an explanation of the functions within the question and a table, 
which Includes an exact reproduction of all responses siade by 
each student and the response latency for each trial. This inform- 
matlon was obtained from student record analyses from the cow- 

i’^' I ‘ < 

puter and Is representative of one of the benefits that an author 
can derive frow the cowputer In revising and updating course 
material. 

I 

i ' * - ' ^ , 

■ ' ~ ' / - ' ' ' ' ' ' ~ ' 



















Sawple Question l». »Speech Pathalo^y and Audiology 



Seouence Ho . 
aa-01 30-470 



Label 



Op Code 
qu 



nx 

fn 

ca 

ty 



nx 

ad 

un 



Argument 



1.Z9.* Completion; The 
other part of the Inner ear 
having to do with balance 
Is » according to Hewby» 
called the . 



kw//l 



// vestibul 



Correct,^ Please realize 
that N'^wby is describing 
the w^ivole functioning balance 
part with Its contents. 

Strictly speaking. In terras 
of the geography (not function), 
this part of the Inner ear 
may be subdivided Into two 
types of areas: (a) vesti- 

bule and (b) semicircular 
canals. For the raoraent It 
is important to reraeraber 
that these are parts of the 
bony labyrinth-your class 
lecture will develop this 
further. 



-1//C1 



Wrong. Check Newby page 21, 
the fourth complete paragraph 
from the top. Look for the 
name of the major part— not 
the sub-parts. Try again. 



*H.B. Material In Italics Indicates this will appear In 
red on printout. 



1 o 

I ERIC 
* 1 — ' 








Sample Question 1. This is a completion question. The 
student is expected to fill in the. blank after referring to the 
textbook. The authors are expecting only one correct answer 
(ca), i.e., vestibul. If the Otudent makes this response, he 

receives a type out (ty which says “correct" and gives him. in- 
forration about some additional material he will study. If the. 
student'does hot make this correct response, -1 is added to 
counter 1 and he is given the feedback for an unanticipated (uh) 
answer. He is told at this point that he is wrong and should 
check the textbook and try again. The information from student 
records presented in Table 4.5 indicates that four of the six 
students did respond correctly on the first trial. Those who 
did not, made spelling errors. It should be pointed out that 
none of the students responded with the precise response that 
the authors specified, i.e., "vestibul." The correct response 
programed by the authors contains the essential portion of the 
complete correct answer and allows for deviations of word end- 
ings that the authors were willing to accept as correct. The 
students could respond with the entire word, vestibul or vfei^ti- 
buls or vestibular, plus the word "apparatus" without being 
counted incorrect. This indicates the flexibility that authors 
can provide for accepting different forms of the same correct 
answer and not forcing the student to match precisely character 
for character any one given answer. This flexibility is pro- 
vided by the keyword (kw) function which appears just prior 
to the correOt answer (ca) in the program. 
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Table 4*5 

Student Responses and Response Latencies 
for Sample Question 1 from CAI 
Speech Pathology and Audiology Course 

Field Trial, Spring 1966- 



Student 

Humber 


Trial 1 


Ll» 


Trial 2 


L2* 


7577 


vestibular 

apparatus 


9.1 






7578 


vestibular 

apparatus 


13.1 




, S * 


7579 


vestibular 

apparatus 


31.4 






7580 


vastibular 

apparatus 


107.6 


vestibular 

apparatus 


33.3 


7581 


vestibular 

apparatus 


12.9 






7582 


vastibular 

apparatus 


13.5 


vestibular 

apparatus 


24.8 



^2n seconds 





ANATOMICAL TERMS 



These are terms that you should learn how to use and spell correctly. You 
already know many of them or you could easily guess their meanings. The pro- 
cedure will be to have th^ computer lead you through the writing of the words 
in pairs. Consider the word pqirs as synonyms, antonyms, of words which are 
used together. When you are ready to prc;eed, press; EOB 

Write the "paired v'ord" below. 

1 . distal - - 

2, deep ■ 

3o posterior - ■ 

4, inferior 

5, anterior - 

6, superior ^ ■ ’ 

7, central ’ ' ~ ' ' 

8, internal 

9, caudal ' 

10. peripheral ■ . 

Tl. iaxternaf 

12. proximal ’ - 

13. para-sagittal ■ 

14. cephalic ■■ ■ ' ' ■ 

15. ventral . ■ - ■ 

16. coronal . ■ ' ' ' ■ 

17. lateral . ■ - , 

18. ; dorsal ■ 

19. superficial ’ ■ 

20. medial ‘ ' 

- '21. -'sagittal'’' ■ 

■■ '.22v' ■ frontal'' • ■ ■' 

Fig. 2p Student Handout for SPA 430 
(referred to in Sample Question 2) 
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Sample Question 2,--$peech Pathology and Audiology 






S equenc e Ho. 
bb-OQlO-210 



Label 



Op Code 

q« 



Argument 



If medial (#20) means 
in the middle, what word on 
your Handout means to the 
side? 



nx 

fn 

ca 

ty 

fn 

ty 

fn 

nx 

un 



kw//l 

/ lateral / 17 
Correct 



tape//049 
,.{11ne feed),. 



tape//Q50x 



-1//C0 



Wrong. What word on your 
Handout Is also a term used 
In football for a pass to 
the side? 



un 



On the sides of geegrophical 
areas are Zatltud^s. Try 
again. 



un 



Try again. 



Sample Question 2. The programing In sample question 2 is 
more complex than that of the previous question. The student 
is referred to his handout where he will find the answer to the 
question presented \:o him. In this case there are two possible 






er|c 



II 



0 



a! 



Hi 

O 
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correct answers which the authors were willing to accept* 1«e.» 
“lateral** or '*17.*' The authors Indicated this In the program 
by preceding the correct answer (ca) with a keyword (kw) func- 
tion. The keyword function requires only one of the correct 
answers in the ca to be matched* that Is* either “lateral*’ or 
"17*“ If the student matches one of these two correct answers^ 
he gets the typeput (ty) '’correct.'* The tape message Is then 
played for him* the paper In his terminal Is advanced with a 
linefeed command* and the next question Is presented. In the 
event that he does not respond correctly* -1 Is added tp counter 
0 and the first unanticipated (un) answer Is typed out for him. 
The cpmnuter checks the counters later in the program to deter- 
mine appropriate remedial branching. The un tells him that 
he Is wrong and gives him a hint In regar^i'tp the correct 
answer. In the event that he makes repeated wrong responses 
to the question, the successive un*s are presented to him. ■ 
After the fourth Incorrect response, the final un Is repeated 
to him. Table 4.6 presents the responses and the response la- 
tency of each student to this question. This analysis shows 
that students made content errors rather than spelling errors* 
as was the case In the preceding question. 




44 



Table 4.6 

Student Responses and Response Latencies 
for Sample Questions from CAI 
Speech Pathology and Audiology Course 

Field Trial, Spring 1966- 



Student 

Number 


Trial 1 


Ll® 


Trial 2 


L2* 


7577 


superficial 


106.5 


lateral 


8.2 


7576 


lateral 


19.7 


' * I 




7579 


distal 


3.8 


jateral 


4.2 


7580 


lateral 


3.9 






7581 


peripheral 


95.0 


lateral 


8.0 


7582 


peripheral 


20.4 


lateral 


8.8 


758? 


lateral 


14.9 







^In seconds 
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SawpTfe Question 3"«Speech Pathology and Audiology 



Seouoncc No. 
cc-0040-410 



Label 



ERIC 



Op Code 
rd 



ty 

qu 



nx 

fn 

ca 



ty 



fn 

nx 

fn 

wa 

ty 



nx 



Argument 



Locate the kidney 
shape In the upper left 
region of the medial wall. 



wa1t//10 
,,(11ne feed),. 



This kidney shape Is 
the place where "sound” 
enters the Inner ear* What 
does this kidney shape 
represent? 



kw//2 



/ oval / window / fenestra / 
oval Is 



Correct. You might want to 
label your Handout. 



wa1t//5 



kw//l 



/ footplate / base 



The footplate of the stapes 
Ties within the kidney-shape. 
However, the arch of the 
stapes remains within the 
middle ear cavity. The 
kidney shape Is Intended to 
represent a hoi e 1 n 'the medi al 
wan of the middle ear cavity. 
Try again. 






l iilill i i l lii ei lli l 
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Sequence No » 



Label 



Op Code 
fn 
wa 
ty 



nx 

fn 

wa 

ty 



un 



un 



un 



Arqument 

kw//l 

i round /rotunda 



This Handout has not distorted 
the round window Into a kidney 
shape. You should know 
by now that the round win- 
dow Is not the main sound 
conducting mechanism leading 
from the middle ear to the 
Inner ear. Try again. 



kw//l 



/ stapes / stirrup 



The footplate of the stapes 
fits Into this kidney shape. 
What does the kidney shape 
represent? Try again. 



Dqn^t let this Handout con- 
fuse you. Following the 
normal path of sound conduc< 
tion, what kidney-shaped 
opening “connects’’ the 
middle ear and the Inner 
ear? Try again. 



This Opening Is a window. 
Try again. 



The correct answer Is: 
oval window. Type this. 



Sample Question 3. The authors have anticipated two forms 
of the correct answer - the common English name and the more 
technical name - and have anticipated six wrong answers which 
Students might make. The question Is presented to the student 



|er|c 



( 



i 
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it 



and the system waits for the student to respond. If he responds 
with any of the two words from the correct answer (ca), it will 
be counted as correct. This ca is controlled by the preceding 
keyword (kw) function which specifies that t**o of the elements 
of the ca must match. If the student responds correctly, he 
receives the typeout (ty) “correct," and the suggestion that 
he might want to label his handout. The system then waits five 
seconds as specified by the authors so that the student can 
add the label to his handout. If the student does not respond 
with the correct answer, the system checks to see if any of 
the specified wrong answers (wa) have been given. If the stu- 
dent response matches a wa, the following ty is presented to 
the student and the system waits for the student to respond 
again with the correct answer. As in the preceding question, 
the authors have provided for three unanticipated answers with 
the last one being repeated* for each succeeding unanticipated 
answer. Table 4.7 contains material obtained from student 
records in the system f.nd indicates that all but one of the 
students responded correctly on the first trial. One student, 
after receiving the first un with additional information, re- 
sponded correctly on the second trial and then proceeded to 
the next question. The reader should note the wide variability 
in response latency among five students. 
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Table 4.7 

Student Responses and Response Latencies 
for Sample Question 3 from CAI 
Speech Pathology and Audiology Course 

Field Trial, Spring 1966 



{ 



Student 

Number 


Trial 1 


r LI® 


Trial 2 


L2® 


mi 


oval window 


'' VI' ^ 

8.5 






7578 


~ basal end ov 
the cochlea 

. . V 


98.3 


oval window 


26.9 


7579 


.4 

oval window , 


7.2 




- 


7580 


oval window 


6.3 






7581 


oval window. 


41.7 






7583 


oval window 


135.1 . 







\ 

I 



®In seconds 



. 

ERIC 



Sample Question 4»-$peech Patholopy and Audiology 



Sequence No. 


Lgjel 


0£ Code 


Arqument 


11-0070-'400 




qu 


9 ^ 10 , What end-organ is 
affected by stopping and 
starting motions? 






nx 








fn 


kw//l 






ca 


/macula 






ty 


Correct. 






br 


qul//cl//e//l 






ad 


-1//C0 






nx 








Id 


1//C1 






fn 


pa0//32*t//50 






wa 


macula 




■ 


un 


Wrong. Try again. 






un 


Type: macula 






rd 




• 




Id 


C7/cl 






ty 


,,(line feed),. 


Sample 


Question 4 


. The authors used counters extensively 



in this program to control the progress and branching of students 
throughout the instructional strategies. A keyword (kw) func- 
tion is used to examine the first correct response “macula.** 
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If a match occurs, the student receives the typeout (ty) "correct" 
and control passes to the following branch (br) statement, which 
commands the system to branch to the next ques^,ion if counter 1 
equals 1. If this condition is not met, control passes to the 
add (ad) statement and -1 is added to co«jnter 0 before branching 
automatically to the next question. If the student’s response 
is not correct a;.' does not match the first ca, the nx statement 
after the ad statement takes control and immediately passes con- 
trol to the next load (Id) statement. At this point, ** is 
loadedinto counter 1 and control passes to the following paO 
function. The paO function is checking for the same response 
as the original kw function specified except that it will ex- 
amine the student's response in small segments and will require 
only a 50 per cent match to meet the requirements of the paO 
function. If 50 per cent of the student's response matches the 
stored "wrong answer," the paO function will type the correct 
answer to the student and will require the student to type the 
correct answer before proceeding with the course. When the stu 
dent responds this time, he undoubtedly will make the correct 
response which will match the first ca. The system will then 
test the br statement and the student will be branched to the 
next qu because counter 1 equals 1. 



o 
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Table 4.8 

# 

Student Responses and Response Latencies 
for Sample Question 4 from CAI 
Speech Pathology and Audiology Course 

Field Trial, Spring 1966 



Student 




u® 




L2* 


^ A 


Number 


Trial 1 


Trial 2 


Trial 3 L3* 


7577 


crista 


27.2 


maculae 


29.0 




7579 


macula 


7.4 








7580 


crista 


13.1 


maculae 


22.6 




7581 


crista 


16.5 


othollthic 

membranes 


58.1 


macula 9.0 



^In seconds 
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Sample Question 5,--Speech Pathology and Audiology 

Seouence No. Label Op Code Argutnent 

jj-0040-010 #s-51a 

Anatomica. Slide: Schema of Cochlear Canal - 

labeled. 

ty This slide shows a highly 

diagrammatic cross section ' 

of the cochlear canal. This 
Is the same as your Handout 9 
but with the parts labeled, 
lotlce that the cochlear 
canal Is divided Into three 
main parts: ( 1 ) the scale 

vistibull; ( 2 ) scala tympam ; 
and ( 3 ) scala niedia (I.e., 
the space Inside the cochlear 
duct). 



ty 


j,( 11 ne feed) ,, 


rd 


Correct your Handout If 
necessary. Make sure that 
all parts are labeled. 

When ready to proceed 5 
press EOB. 


fn 


sb///nxl//aO///rmdone 


rd 




ty 


, ,{ 1 Ine feed ) 59 


ty 


Here are a couple of ques- 
tions related to this area. 


ty 


,s(line feed) ,, 


qu 


lO’-l, Energy delivered Into 
the footplate of the stapes 
would be delivered Into 
which scala? 


fn 


kw//l 
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Sequence No . Label Op Cod^ 

ca 

ty 



fn 

un 

uh 



Argument 

/vestibul 

Correct; (i.e., the seal a 
veetihuli onnects to the 
vestibule and therefore to 
the oval window area.) Refer 
to the previous Handout; 
Membranous Labyrinth to see 
this illustrated. 

wait//10 

Wrong. Your previous Handout; 
Membranous Labyrinth ought 
to give you a ,*tnt is to the 
correct answer. Try again. 

Type; vestibuli 



Sample Question 5. This question begins with an author 
comment which is indicated in the label field by the number sym- 
bol (#). This comment appears in the compile listing only and 
enables an author to insert reference comments related to specific 
functions in the course. The course continues with a ty state- 
ment to the student which presents information in a sequenced 
way. The following ty statement is a linefeed command which 
causes the student's terminal to advance the paper a single or 
double space for formating purposes. This function enables the 
author to structure the physical layout of the material which 
the student is receiving. A read (rd) statement is then pre- 
sented to the student which instructs him to check his handout 
and see if It is labeled properly. The next function branches 
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to a subroutine (sb///nxl//aO///rnKlone) and then returns to this 
question to check on certain conditions of the student's counters 
and his progress. Another linefeed is then activated and new 
material related to this area is started. The question (qu) is 
then presented and the system waits for the student to respond. 
The authors have anticipated only one correct response to this 
question. If the student makes this correct response » he re- 
ceives the typeout (ty) which informs him that he is correct 
and refers to a previous handout. The system waits te'i seconds* 
as specified by the authors, and then proceeds to the next 
question. If the student responds incorrectly, he receives 
the unanticipated (un) response "wrong" and is referred to a 
previous handout. On his second Incorrect rvesponse, he is given 
the correct answer and instructed to type it. Table 4.9 indi- 
cates that only one student responded correctly on the first 
trial, one student responded correctly on the second trial, ^ 
one on. the third trial, and one on the fourth trial. 
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Results of Field Trial 

Table 4.10 presents the posttest and retention test scores 
for students who participated In the field trial of the speech 
pathology and audiology material. Since the retention test was 
administered the term following the field trial, some students 
were not available to take the test because they were graduated 
at the end of the term, withdrew or transferred from Penn State. 
Table 4.11 presents the mean and standard deviation on t#e post- 
test and retention test for each group. A one-way analysis of 
variance on the posttest scores was performed. The results of 
this analysis are presented In Table 4.12. 
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Table 4.10 



Posttest and Retention Test Scores 
for Speech Pathology and AudloTagy Field Trial 

Spring, 1966 




Posttest Retention Test 



Self "Study Group 



1 

2 

3 

4 

5 

6 

7 

Lecture Group 

8 
9 

10 

11 

12 

13 

14 

CAI Group 

7577 

7578 

7579 

7580 

7581 

7582 

7583 - 



105 


m» mm 


55 


10 


83 


22 


80 


29 


108 


36 


89 


39 


75 


m •• 



91 


mm <n 


88 


29 


102 


49 


92 


- - 


92 


26 


91 




114 


-- 



104 


30 


56^ 


mm mm 


99 




88 


31 


75 


21 


72 


, -- 


89 


00 










58 



Table 4.11 

Mean and Standard Deviation for Each ^ 
in the Speech Pathology and Audiology Field Trial 

Spring Terin, 1966 





Lecture 

Only 


Self-Study 


CAI 


Posttest 




- 




Mean 


95.71 


85.00 


83.28 


" S. D. 


9.18 


18.14 


16.69 


Retention Test 








Mean 


14.86 


19.43 


11.71 


S. D. 


19.89 


16.33 


14.95 



0 

D 

0 

D 

0 

0 



Q 

a 



Table 4.12 

One Way Analysis of Variance on Posttest Scores 
for Speech Pathology and Audiology Field Trial 

Spring Term* 1966 
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Source 


d.f: 


Sum of 
Squares 


Mean 

Square 


F- ratio 


Treatment 


2 


635.14 


- 817.57 


1.37 


Error 


31 


4150.86 


230.60 




Total 


20 


4786.00 








CHAPTER V 

INTRODUCTORY MANAGEMENT ACCOUNTING 
(Joe J. Cramer, Jr. and Carl R. Palmer--Course Authors) 

The management accounting cou»^se (mana) developed for CAI 
IS formally classified as the basic management accounting course 
at The Pennsylvania State University. The completed course for 
CAI was based on two major so?^rces of data. Certain portions 
of the course were drawn from text materials adopted for cur- 
rent use at Penn State. Appreciation Is expressed to McGraw- 
Hill Book Company, Inc., I. Wayne Keller, and William L. Ferrara 
(publisher and authors of the second edition of M&? aqement 
Accounting for Profit Control ) for granting permission to use 
jthese materials In this research project. The second source 
was "Supplementary Reading Assignments" written by the course 
authors for the purpose of expanding and clarifying Important 
accounting concepts and procedures. The objective of the 
teacher of the basic management accounting course - whether 
a CAI system or the traditional classroom lecture - was to pro- 
vide an opportunity for each student to gain exposure to se- 
lected theoretical aspects of management accounting theories 

and their role In management planning and control coupled with 

« 

simulated practical experience (homework problems) which, hope- 
fully, reveal advantages and disadvantages of both conceptual 
observations and practical applications. 
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Development of Course for Computer Presentation 

implicit if! the preyious comments is the fact that manage- 
ment accounting data are vital to decision-making for profit 
optimization. Consequently, Information which facilitates cost 
control (with implications for cost reduction) is the s jnje gua^ 
non on which a management accounting system rests. The com- 
pleted course includes the following topics 

I. Introduction to Management Accounting 

A. The responsibility of accounting and dual 
posting concepts in relation to cost accumu- 
lation for (a) control and (b) income 
measurement permeate the entire course. 

B. Distinction between accounting procedures 

: for merchandising and manufacturing firms 

II V The Cost Accounting Cycle (accounting for 
materials, labor, and overhead) 

III. Basic Cost Accounting Systems (historical and 
standard costing systems) 

A. ubb Order Costing 

B. Process Costing 

IV. Control of Manufacturing Costs (classification 
of costs as fixed, variable, and semi -variable 
for control purposed and usefulness of the 
flexible budget technique for control of 
factory overhead costs) 

Since the project began, curriculum changes were Instituted 
by the accounting department, some of which were incorporated 
in the GAI mariagement accounting course. 

Mine segments were prepared for CAI. Necessity for exten- 
sive revisions of the cost accounting material was traced to 
fiye major factors, which are briefly explained as follows; 
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Modification of original plan to b ase the course exclu» 
sively on text adopted for classroom use . The revised course 
Included assignments based on two Introductory cost accounting 
textbooks. The Keller-Ferrara (1966) text was adopted for use 
at The Pennsylvania State University, and the Horngren (1962) 
text served as an Important reference for students participating 
In CA!. Utilization of selected chapters of a second text 
served two purposes. First, the selected chapters of the Horn- 
gren text either complemented and expanded parallel chapters 
of the Keller-Ferrara text or provided clarification of concepts. 
Second, several case problems from the Horngren te,xt were used 
to provide simulated practical applications of cost accounting 
data. 

Remaining portions of the materials {^‘Supplementary Read- 
ing Assignments'*) were accumulated and/or written specifically 
for the CAI field trial and were circulated In mimeographed 
form to participating students. A sample of this material Is 
presented In Appendix E.l. Such reading assignments were pre- 
pared for the purpose of expanding and clarifying certain Im- 
portant accounting concepts and procedures which empirical evi- 
dence suggested were not readily comprehended by many students. 
Thus, the cost accounting CAI course represented a comprehensive 
set of Instructional media encompassing the Items described 
above and additional assistance for students as described In 
the design of the field trial. 



Revision based on review of computer printouts of students 

- ' ' > • 1 '' ' 

usGd 1 n testing the or1 g1 na 1 prograiH a Many of the revisions 
Incorporated In the course were made as a result of Intensive 
review of students' terminal printouts. For example, additional 
acceptable answers and sufficient hints to "lead" students toward 
correct or acceptable responses were Incorporated In the course. 
These revisions were Immeasurably facilitated as a result of 
Improvements In the Coursewriter language, which provided flexi- 
bility In the ability of the hardware for processing student 
Input, Where applicable, new Coursewriter functions and oper- 
ation codes were Incorporated In the revised course. 

Inclusion of additional problem material s and quizzes, . 
Incorporation of meaningful progress evaluation schemes for 
the student was another factor Influencing course revision. 

The evaluation sequences were programed In a manner similar 
to "quizzes^" The purpose of this aspect of course revision 
was to highlight computer-assisted Instruction as a tutorial 
device which Is sensitive to Individual differences among stu- 
dents, Evaluation sequences, therefore, were presented as an 
Instructional device designed exclusively for diagnostic pur- 

f t ' 

poses and not as a measure of achievement. This technique was 
used to prompt student review In cases where remedial work was 
indicated, to correct unsatisfactory progress, and to clarify 
misconceptions. Throughout the revised course, primary reliance 
was placed on the student to determine the extent to which 




f 
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remedial materials or reviews were needed. The course used 

extensive branching, but no effort was mad® to force feed 
materials to the student. A significant level of preparation 
of each assignment was assumed and required prior to each session 

with the computer. 

Additional case problems were included so that the student 
could acquire a form of simulated experience In applying theo- 
retical concepts discussed In assigned reading materials. Case 
problems wore provided prior to computer sessions so that stu- 
dents could read appropriate materials and prepare solutions 
as component parts of each assignment. A sample of these is 

presented in Appendix E.2. . 

Influence of curriculum changes, on course , revlsi ^. The 

management accounting course underwent substantial changes In 
purpose, orientation, and content since the project was Initiated 
In April 1964. Curriculum changes Instituted by the accounting 
department changed this course from fifth to second in a series 
of introductory accounting courses. Additional course content 
relatlpg to broader management uses of accounting data were In 
eluded, along with an Introduction of the budgetary planning 
process. Since the course became a requirement for all students 
4^ r.niioae of Business Administration, students are more 
evenly distributed among accounting majors and non^accounting 
majors. Ihese changes required very extensive revision of the 

original CAI course. 




0 
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Reaction of Students , The following comments are based on 
observations of students who tested parts of the cost accounting 
program during fall term* 1964. fifteen students who were con- 
currently eniolled In the course for college credit volunteered 
to serve as subjects. Portions of segments 1> 2f 3,- and .6 of 
the program were tested. Students Indicated that they were Ini- 
tially fascinated by CAf and Impressed by the large degree of 
student Independence which characterized the learning situation, 



as well as the ability to proceed at their own pace. Three ’.stu- 
dents Informed the course author that for the first time during 
their college careers they were able to ask meaningful questions 
In class as a result of reviewing terminal printouts.^ In addi- 
tion, students expressed great satisfaction for being given an 
opportunity to participate In a curriculum development project 
with their classroom Instructor. This type of student-teacher 
association (at the larger university) Is usually limited to 
the graduate student. 

Several students became bored after having worked at the 
terminal for a few sessions. Discussions with these students 
revealed the following reasons for this sltuatlont inability 
tO“ proceed at the same pace as formal classroom assignments be- 
cause of constraints on^ computer time ahdtfbcill ties , and neces- 
sity to. In effect, prepare "two“ assignments - one for actual 



Hhese observations may not be applicable In situations 
where students are exposed to CAI only. 
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course credit and the other for the research project. Demands 
on students' time In view of enrollment In other courses thus 
accounts for part of this reaction. Some studc .ts expressed 
concern relative to exposure to a new teaching medium or Ina-* 
blllty to type as proficiently as they would have liked, coupled 
with the mere Idea of having to "operate a machine." Most stu- 
dents subsequently adjusted to CAI If they were permitted to 
work alone, and If help was available In case of difficulty with 
hardware and course content. 

r 

Field Trial 

A field trial of the CAI management accounting course was 
conducted during the spring term, 1966. The purposes of the 
study were twofold: 1) to Investigate the problems Involved 

with providing CAI experience for a number of students on a 
regular basis for academic credit, and 2) to gather data for . 
improving the course based on student responses and reactions. 

Random Assignment of Student s. The 36 students who enrolled 
In Accounting 102.8 were stratified Into three levels on the 
basis of examination grades from the prerequisite course Account- 
ing 101. The students In each of the stratified groups were 
then randomly assigned to one of the field study conditions 
lecture, self-study, or CAI. Five of the students dropped the 
course shortly after it started. Eight students remained in 
the self-stMdy group, 10 students in the CAI group, and 13 stu- 
dents remained in the lecture group. All students received a 
copy of the Course Outline for Accounting 102 (Appendix E.3). 
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LectUfG Group * The 13 students assl 906 d to the lecture 
group met with the professor three periods (75 minutes each) 
weekly. This segment of the class group was taught according 
to the standard procedures used by the professor for a lecture- 
discussion class. 

Self-Study Group . Eight students were assigned to the self^ 
study group. These students met in the lecture group one period 
each week with the professor and were assigned to the Curriculum 
Materials Center for two periods each week. Appendix E.4 in- 
cludes a list of related materials available in the Curriculum 
Materials Center. Table 5.1 indicates the amount of time spent 
in the Curriculum Materials Center by each student who was as- 
signed to the self-study group. The students were not Informed 
that a record was being made of the amount of time they spent 
in the Center, nor was this time used to evaluate the students 
in any way. It merely indicates that some students spent con- 
siderably more time than others in using the specific references 

placed in the Center. 

■ ' ' , ' ' ' ^ ' 

CAI Group . Ten students were assigned to the CAI group. 
These students met with the professor and the rest of the class 
one period each week and were assigned time at the CAI terminal 
for approximately two periods each week. Appendix E.5 contains 
a sample of the program with slides and tape-^recorded messages, 
and Appendix E.6 contains samples of static displays. 
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Table 5,1 

Time Spent in Curriculum Materials Center 
by Students in the Management Accounting Self-Study firoup 

Spring 1966 
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Table 5.2 shows the structure and amount of course materia] 
stored in the computer. The course Is segmented into chapters 
for ease of handling at the Computation Center; however, a stu- 
dent taking the course goes directly from one chapter to the 
next if he so desires. 



Table 5.2 

Structure of CAI Management Accounting Course 



Chapters 


Nol of 

Coursewriter 

Instructions 


No. of No. of 
Questions Slides 


No. of 
Tape- 
Recorded 
Messages 


No. of 
Static 
Displays 


1 


936 


62 


39 


28 


— 


2 


238 


9 


9 


6 




3 


1006 


82 






3 




800 


33 


6 




6 


5 


556 


29 


5 


m mt 




6 


1046 


10 


8 


•» cv 


6 


7. 


946 


81 


-- 




1 


8 


435 


29 


-- 


•» mm 


. — 


9 


593 


88 


-- 


mm w 


7 


Total 


6556 


423 


67 


34 


23 
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Table 5.3 shows the time spent on computer terminal by the 
students in the manag®*''®*'^ accounting CAI group. 

Table 5.3 

Time Spent on Computer Instructional Terminal 
in the Management Accounting CAI Group 
Field Trial, Spring 1966 



Student 

Number 


Dates 

Beginning-Ending 

1966 


Time 

Hours-Minutes 


Average 

Hours/M0ek“ 

Hours-Minutes 


6752 


4/4 - 


5/25 


16 


6 


2 


1 


7326 


4/4 - 


5/26 


18 


39 


2 


20 


7327 


4/4 - 


5/23 


12 


43 


1 


35 


7328 


4/4 - 


6/1 


20 


3 


2 


30 


732S 


4/4 - 


5/19 


18 


21 


2 


18 


7330 


4/4 - 


6/1 


21 


10 


2 


38 


7331 


4/5 - 


5/11 


12 


50 


1 


36 


7332 


4/4 - 


5/31 


27 


57 


3 


29 


7333 


4/4 - 


6/1 


26 


8 


3 


16 


7334 


4/4 - 


4/28 


9 


10 


k 

1 


9 


Total Time - 181 hours 












Average 


time per student - 18 


hours 


and 8 minutes 







^Calculated on the basis of maximum number of weeks (eight) 
on terminal by student from the group. 
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Table 5.4 shows the character and operand code count for 
five representative, selected questions from the course. On 
the basis of the Information from these five questions, it U 
estimated that for the 423 questions and related Instructions 
In the course, there are approximately 377,700 characters In 

computer storage for the nine chapters. 

The entire question and related materials for each o 
these sample questions ic presented on the following pages. 
Following each question and related material is a table which 
shows the attempts which each student made to answer that ques- 
tion and the response latency for that trial. This Information 
was obtained from student record analyses from the computer and 
is representative of one of the benefits that an author can 
derive from the computer In revising and updating course material 



Table 5.4 

Character and Operand Code Count Five Selected Questions 

from CAI Management Accounting Course 
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Sample Question 1--Management Accounting 



Sequence NOo Label Op Code 
03-0110-000 int3-9 qu 

ca 

ty 

nx 

fn 

ca 

ty 

nx 

fn 

wa 

ty 

un 

un 



Arqument 

For control purposes, data 
must be accumulated by 
Fill in. 

areas of responsibility 

Correct. 

pa0//853//90 

areas of responsibility 

Correct. 

pa0//853t//50 

areas of responsibility 

Correct your errors; try again. 

Remember the definition we 
gave you a short time ago? 

It must relate to areas of 

» 

I 

areas of responsibility 



Sample Question 1. This question is a completion question. 
The authors have anticipated only one correct answer but hdve 
provided several means for processing the student's answer. 

The first correct answer (ca) “areas of responsibility," must 
be matched exactly by the student in order to receive the 
following typeout (ty) “correct." If the student's response 

' 9 s 
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does match the ca, the student receives the ty and proceeds 
to the next question. If the response does not match the stored 
ca exactly, control passes to the next function which is the 
partial -answer processing (paO) function. The authors have 
determined that the student's response must match at least 90% 
of the ca in order to be counted correct. The computer will 
examine the student's response first using a string length of 
eight characters and then five characters and then three char- 
acters to make this decision. If this condition is not met, 
control passes to the next paO function in which the authors 
have specified only a 50% match with the stored "wrong answer 
(wa).“ If the student's response matches 50% of the stored 
wa, the student vHll receive feedback from the paO function. 

The computer will type those portions of the student's response 
which were correct and dashes for those which were incorrect. 

In the event that the student's response does not meet the 50% 
criterion, he then is presented with the unanticipated (un) 
response in which he is prompted and then again presented with 
the question. If upon responding again to this question he 
does not meet the 50% criterion, he is presented with the fol- 
lowing un which simply gives him the correct answer to the 
question. 

Table 5.5 shows the responses made by students to this 
particular question, and the response latencies as recorded 

Seven of the nine students made the correct 



in student records. 
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response on the first trial. One of the remaining students 
made the correct response on the second trial, and the* other 
remaining student made a spelling error In his response which 
meant that he had to type It again on »the third trial. 





Sample Question ^-^Management Accounting 



Sequence No , Label Op Code 
03-0450-000 st3-4 - qu .. 

ca 

cb 

ty 

nx 

fn 

ca 

ty 



■ Argument . • 

Wh a* i s the combi n at 1 on (or 
summation) element? 

factory overhead 

overhead 

Correct--factory overhead 

pa0//543r//85 
factory overhead 
Correct 

Incorrect; it's factory 
overhead. Type It In. 



Sample Question 2. This question presents a slight varia- 
tion In programing to achieve similar results. A correct answer 
(ca) Is followed by an alternate correct answer (cb) which In 
turn Is followed by a typeout (ty). This sequence will cause 
the same to be presented to the student whether he matches 
exactly the ca or the cb. This flexibility saves a great deal 
of clerical time, author's writing time, and computer storage 
space by not having to repeat the tj^ statement for each correct 
answer. The partial-answer processing (paO) function contained 
In this question also uses a variation within the system. The 
543 sequence In the function indicates the string lengths that 
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the system will use In searching the student's response to 
compare It with the stored correct response* The r following 
this string length means that If the 85% correct criterion Is 
met the feedback to the student will consist of correct portions 
typed In black and Incorrect portions typed In red. As«,1s 
standard procedure, the last operation code in the 3ii 
the unanticipated answer (un). 

Table 5.6 shows that eight of the nine students responded 
to this question correctly on the first trial. The ninth stu- 
dent made a spelling error which could have been counted correct 
If the authors had decided to change the criterion level of the 
paO function* The need for changes like these become quite ap- 
parent after student records have been analyzed. With this 
present CAI system, a change such as this can be made easily 
and hence a course can be updated regularly on the basis of new 
Information derived from student records. 
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Table 5.6 

Student Responses and Response Latencies 
for Sample Question 2 from CAI 
Management Accounting Course 
Field Trial, Spring 1966 



Student 

Number 


trial 1 




LI® 


Trial 2 


L2* 


6752 


factory 


overhead 


7.0 






7326 


factory 


overhead 


10.2 






7327 


factroy 


overhead 


11.3 


factory overhead 


9.8 


7328 


factory 


overhead 


9.0 






7329 


factory 


overhead 


11,0 






7330 


overhead 


19.0 






■ ‘ i 

7331 


factory 


overhead 

1 


8.4 






7333 


factory overhead 


7.6 






7334 


factory 


overhead 


8.7 


- 





®In seconds 
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i 

Sample Question 3""Hanagement Accounting 



Sequence No. label 

03-0980-000 en-7 



Ob. Code Argument 

qu If the following are three 

of the four parts of the 
credit portion to entry C 0, 
what Is the fourth paft? 



ca 

ty 

nx 

fn 

ca 

ty 

un 

un 



Ir. federal Income taxes 
payable 15000.00 

,r . ; ‘ ■ 

cr. social security taxes 
payable 3000.00 ‘I 

cri union dues payable^ 1000.00 

pr« cash 92000.00 

Correct 

‘ . i* ‘ 



pa0//853//85 

cr. cash 92000.00 

Correct 

to pay out cash 
don't we? 

cr. cash 92000.00 



Sample Question 3. The authors have followed the sarnie 
procedure with this question as with the previous question. 
However, the responses the students made to this question (Table 
5.7) Indicate that the response behavior of the students was not 
as controlled as was Indicated for the other questions examined 
In this cours^^ Some students required five trials before making 

the correct response. 
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Sample Question 4--Management Accounting 



Sequence No . Laj > e1 Op Code Argument 

04-0380-000 1nt4-28 qu Who requisitions the mateiials 

and therefore controls or has 
authority to control the 
obtaining of materials from 
the stockroom? 

ea foreman 

cb foremen 

ty Cprrect. 

nx 

' * ■ _ . ' 

fn pa0//43r//80 

ca foremen 

ty Correct. 

un Incorrect. Try again. 

un Didn't we go over the point 

earlier? The foremen 
In the production departments 
are authorized to Issue 
materials requisitions. 



Sample Question 4. The authors have provided for two cor- 
rect responses to this question. If the student makes either 
of these correct responses, he will get the feedback "correct." 
The author has also provided for some degree of misspelling by 
using the paC function with criterion level of 80^< If a stu- 
dent does not reach this criterion, he receives the first un; 
on the second trial If he still has not reached the criterion 
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level, he receives the second ,un which contains the correct 
answer. Table 5.8 presents the student responses and response 
latencies for this sample question in the management accounting 
course. 1« checking this portion of student records, Student 
7330 presented p slightly different problem. On trial i he made 
a correct response; on 'rial 3 he made a correct response with 
an incorrect response on trial 2. An inspection of the times 
and dates recorded in student records revealed that the student 
responded correctly to this question the first time and then 
signed off. He returned the following day to continue with his 
study. In the event that a student signs off in the middle of 
a segm( ,t and then continues at a future time, the la-'t question 
presented to him before sign-off will be presented again at the 
beginning of the next sign-on of that segment. This provides 
a slight amount of overlap in the work that a student Maes in 
the program but also provides some .eview for the student who 

Is signing on to the program. 



Table 5.8 

Student Responses and Response Latencies for Sample 
Question 4. from CAI Management Accounting Course 

Field Trial, Spring 1966 
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Sample Question 5 — Management Accounting 

Label 



Sequence No 
03-1000-000 



en-9 



^ Code 


Araument 


qu 


What is the debit portion of 
entry do? 


ca 


dr. factory overhead 17000.00 


cb 


dr. factory overhead control 
17000.00 


cb 


dr. overhead 17000.00 


ty 


Right 


nx 




fn 


pa0//853//85 


ca 


dr. factory overhead 17000.00 




Okay 


nx 




fn 


kw//3 


wa 


dr., factory . overhead 


ty 


The account is factory over- 
head, what is the amount? 



R6ni6jnD6r siivry o u 
fact that total factory over- 
head per the statement is 
28000. Type the entire debit 
portion of the entry as 
your answer# please. 



Sample Question 5. This question presents an example of 
the problems involved with programing for multiple word answers 
The first: correct answer (ca) and the first and secusia correct 
answers (cb) provide the exact answers in storage which the 
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student might he able to match. However, It Is very unlikely 
that a student would enter this response exactly as the "author 
had planned It to the extent of changing abbreviations or spac- 
ing or even the order of the elements In the answer. Therefore, 
the author has provided two other processing functions to allow 
variation In student responses. The first function (paO) pre- 
sents the same answer in the following ca but requires only an 
85X match with the student's response to be counted as correct. 
This function In addition to allowing variations In the sequencing 
of the elements In the response would also allow for slight mis- 
spellings within any of the elements. The following function 
(kw) allows for the changed sequence of the three elements but 
will not allow for any misspelling within the three elements. 

It Is apparent from the student records presented In Table 5.9 
that the author Is allowing some responses to be considered 
correct which essentially are not correct. The partial -answer 



processing requiring only 851» match allows enough flexibility 
In the student response that the $17000 does not have to be 
matched precisely. Student 7328 entered $18000 and was* permitted 
to proceed to the next question. Likewise, student 7331 entered 
$18,000 and proceeded to the next question. At this point the 
authors are more concerned with the concepts Involved In management 



accounting rather than In the specific details of amounts and 



val ues. 
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Results of Field Trial 

The criterion measures on each of the students In the manage 
ment accounting field study are presented In Table 5.10* Because 
some of the students Involved In the field study were graduated 
at the end of the term, withdrew or transferred from Penn State, 
retention test could not be administered and scores are not 
available. 



er|c 
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Table 5J0 

Criterion Measures of Students 
in Management Accounting Field Trial 
Spring Term, 1966 



student 


Exam 

I 


Exam 

II 


Home- 

work 


Final 

Grade 


Retention 

Test 


Self-Study 

Group 

1 


B 


D 


F 


c 




Z 


F 


F 


F 


F 


•m M 


3 


C 


F 


F 


D 


- - 


4 


D 


F 


F 


D 


-- 


5 


D 


c« 


A 


C 


50 


6 


F 


F 


F 


F 


27 


7 


C 


C- 


F 


C 


- - 


8 


D 


D- 


F 


D 


• • 


Lecture 

Group 


9 


C 


C- 


A 


B 




10 


D 


D- 


F 


0 


26 


11 


B 


D 


F 


C 


-- 


12 


A 


A 


A 


A 


mm mm 


13 


B 


m a* 


F 


C 


- • 


14 


F 


X 


F 


X 




15 


C 


C- 


A 


C 


• • 


16 


F 


C- 


A 


C 


- • 


17 


D 


D+ 


F 


D 


• • 


18 


B 


D- 


F 


C 


m mm 


19 


A 


C- 


F 


B 


36 


20 


F 


F 


F 


F 


27 


21 


F 


WF 


F 


WF 




CAI Group 


6752 


F 


i: 

« 


c 

• 


F 




< 7326 


D 


D 


F 


D 


50 


7327 


F 


D+ 


F 


D 


15 . 


7328 


F 


D+ 


F 


D 




7329 


F 


F 


F 


F 


8 


7330 


F 


F 


F 


F 


m • 


7331 


C 


D 


F 


D 




7332 


B 


C- 


F 


C 


80 


7333 


F 


F 


F 


F 


28 


7334 


A 


C- 


F 


B 


33 
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(Carl R. Moss and David A. G11man--Course Authors) 

The engineering economics (engecon) course prepared for 
CAI was for advanced undergraduate and graduate students pre- 
paring for careers in industrial engineering, other engineering 
specialties, or business. The course included problems in in- 
vestment, equitable return, and cost methods of analysis. 

The CAI program for engineering economics utilized visual 
material in the form of slide presentations. However, the princi 
pie co/nponents of the course were static displays arid student- 
computer interaction. 

The strategy of instruction for the program used the fol- 

lowirig basic assumptions: 

1. The solution of numerical problems is both an 
aid to and an indication of understanding of 
economics concepts. 

2. Remedial instruction should be contingent upon 
the type of error made^ by the student. 

\ 

3. Active participation by a student produces a 
more effective learning experience. 

4. Knowledge of one's progress contributes to 
effective learning. 

The engineering economics CAI course underwent substantial 
change in orientation and content in preparation for the field 
trial. Some display material was converted to slide presenta- 
tions. Partial-answer and keyword functions were added to 
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make the course more flexible. Still > there were some 1'rtstances 
In which the student did not react to questions In the manner 
that the authors had anticipated. The experience gained by the 
authors In this regard emphasized the necessity to phrase ques- 
tions so that the Intent of the author Is clearly communicated 

to the students. 

Field Trial 

A field trial of the CAI engineering economics course was 
conducted during the summer term of 1966. The purposes of the 
study were twofold: 1) to Investigate the problems Involved In 

providing CAI experience for a number of students on a regular 
basis for academic credit, and 2) to gather data for Improving 
the course based on student responses and reactions. 

Random Assignment of Students . The 20 students enrolled 
In the class were randomly assigned to one of the field trial 
conditions - lecture, self-study, or CAI. All students enrolled 
In the course received a copy of the course outline, which 
appears In Appendix F.l. 

Lecture Group . The seven students assigned to the lecture 
group met with the professor three periods (75 minutes each) 
weekly. This segment of the class group was taught according to 
the standard procedures used by the professor for a lecture- 
discussion class. 

Self-Study Group . Seven students were assigned to the 
self-study group. These students met In the lecture group one 
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period each week with the professor and were assigned to the 
Carrlculum Materials Center In the College of Education or the 
Engineering Library two periods each week. The special reference 
materials which were placed in these locations for Individual 
study are listed In the course outline for the course (Appen- 
dix F.l). 

CAi Group . Six students were assigned to the CAI group. 

These students met with the professor and the rest of the class 
one period each week and were assigned time on the CAI terminal 
for approximately two periods each week^ Appendix F.2 contHns 
a sample of the CAI engineering economics program and includes 
samples of the slide display and tape messages In the program. 

Table 6.1 shows the structure and amount of bourse material 
stored In the computer. The course Is segmented Into chapters 
for ease of handling at the Computation Center; however, a stu- 
dent taking the course goes directly from one chapter to the 
next If he so desires. Table 6.2 shows the time spent on In- 
structional terminal for the students In the engineering economics 
CAI group. 

Table 6.3 shows the character and operand code count for 
five representative, selected questions from the course. On 
the basis of Information from these five questions. It Is esti- 
mated that for the 794 questions and related Instructions In 
the course, there are approximately 396,137 characters In 
computer storage for the six chapters. 
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Table 6.1 

Structure of CAI Engineering Economics Course 
Field Trial j Summer 1966 



Chapter 


No. of 

Coursewriter 

Instructions 


No. of 
Qu's 


No. of 
Slides 


No. of 
Tape 

Messages 


No. of 
Static 
Display 


engeconlOl 


356 


28 


5 


7 


8 


ee2 


1142 


173 


mt m 




11 


ee3 


961 


78 


mm w 


-- 


22 


engeconl04 


769 


61 


M mm 




7 


engeconlOS 


589 


51 


-- 




11 


engeconl06 


323 


403 




— 


2 


Total 


4140 


794 


5 


7 


61 



Table 6.2 

Time Spent on Computer Terminal by Students 
in the Engineering Economics CAI Group 
Field Trial, Summer 1966 



Student 

Number 


Dates 

Beginning»Ending 

1966 


Time 

Hours-Minutes 


Average 
Hours /Week a 
Hours-Minutes 


0028 


6/29 - 8/9 


13 


33 


2 


16 


0031 


6/29 - 8/10 


8 


31 


1 


25 


0037 


6/29 - 8/2 


17 


6 


2 


51 


0125 


6/30 - 8/9 


12 


22 


2 


4 


0961 


6/27 - 7/21 


9 


23 


1 


34 


0967 


6/28 - 8/2 


10 


59 


1 


50 


Total Time - 


71 hours and 54 


minutes 








Average time 


per student - 12 


hours 









^Calculated on the basis of maximum number of weeks (six) on 
terminal by student from the group. 



Table 6.3 

Character and Operand Code Count for Five Selected Questions 

from Engineering Economics Course 
Field Trials Summer 1966 
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The entire question and related materials for each of these 
selected sample questions are presented on the following pages. 
This field trial was conducted partially on the 7010, computer 
located at the T. J. Matson IBM Research Center in Yorktown 
Heights. New York, and partially on the 1410 computer located 
at the Compute on Center on Penn State Campus., Therefore some 
of the data which is normally available from student records 
were not available for this field trial. Following eaqh ques- 
tion and related material is a table which shows the attempts 
which each student made to answer that question. This is an 
example of the benefit that an author can derive from the com- 
i puter for revising and updating course material. 



0 

0 

0 



0 

0 









ERIC 









Hwple Question l-*Eng1neer1ng Economics 



Sequence No , Label Op Code Argument 

\ 

rd Why Is accounting Important 

to economic analysis? Write 
a statement or list on a 
piece of paper. When you 
are finished (EOB). 

rd 

ty Your statement should be 

something like the following: 
Historical cost data, assets, 
liabilities, and ownership 
are found In the accounting 
reports of an organization. 



S ample Question 1. This particular question has a unique 
value; It demonstrates that essay questions can be presented 
In CAI. Even though the author does not get specific data on 
the student's response, the student does gain some benefit by 
being questioned and responding In a free form. The computer 
system cannot accommodate a response of more than 99 characters; 
therefore, no student records were available on the responses 
to this particular question. 
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Sample Question 2-»»Eng1neer1ng Economics 



Sequence No* Labe ^ Op Code 

1-5 qu 




nx 



fn 

ca 




br 

nx 

fn 

wa 



Argument 

Ori a short run order of 1,000 
pieces, H requires 2 hours 
of labor at $2,S0/hr. to 
fabricate a part at the 
bench. This same product 
can be fabricated In 1 hr. 

If a jig Is made to aid In 
its production. How much 
can be paid for the jig, 
the product still not costing 
any more. If material and 
all other costs .emaln the 
same? 



kw//2 

#$#2500 #2500. #2500 #2,500 
#2,500.#olUrs 

Very good. $2,500 represents 
the break-even point; that 
is. If s Jig did cost $2,500 
It would cost as much to 
produce the 1 ,000 parts v 
without the jig as with the 
jig. $2,500 Is the maximum 
that could be paid for the 
jig without Increasing pro- - 
ductlon costs. 

1-10 



kw//l 

#2500 #2,500 #2500. #2 ,500. 



ty Incorrect. Be sure to type 

both number and units. 

Also, be sure to space 
between number and units. 




Sequence No . 



Label 



Argument 



Op Code 



un Your answer Is incorrect. 

Try again. 

un Incorrect. Hint; The 

break-even point of both 
alternatives will give you 
the amount you carv pay for 
the jig. Try again. 

un The correct answer is 

$2,500, Type 



S amp 1 e Questi on Question 2 illustrates some of the 
problems involved in processing numerical answers. The correct 
response is processed using a keyword (kw) function. The func- 
tion specifies two key words which the student must match. The 
following correct answer (ca) includes all of the forms of the 
correct answer which the author is willing to accept. One of 
the- correct words which the author is assuming will be present 
is either the dollar sign or the word dollars spelled out. The 



other key word the author is expecting is 2500 written in the 
various forms which it might assume with the variations of 
decimal points and commas. If the student matches two of these 
key words, he receives the following typeout (ty) a*^d is branched 
to the next question. The author has also anticipated a wrong 



*N.B. Material in italics indicates this will appear in 
red on the printout. 




answer (wa) which he ass> lies will be the absence of the unit, 
sign of the numeral. If the student omits the unit sign* the 
author tells him that he Is Incorrect and to Include It. The 
author has also provided for three unanticipated responses which 
the student will receive In succession. 

Table 6.4 presents the responses which students made to 
this question. Three of the five students made a correct re- 
sponse the first time. One of the remaining students required ^ 
three trials to get the correct response and the remaining stu- 
dent required four trials to get the correct response. It Is 
Interesting to note that student number 0967 on his fourth trial 
Imbedded the correct response within a sentence. Because the 
program was written to Incorporate the keyword function, the 
key word, I.e., $2,500 was taken from the student's answer and 
accepted as correct by the system. 
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Sample Question 3-^Engineerlng Economics 



Sequence No . 



Label 



C17-2 



Op Code 


Araument 


rd 


Read paragraph 03-17. (EOB) 


qu 


How would you write the 
equation for the general 
case of the cost function? 


nx 




fn 


kw//5 


ca 


.. #c#»#mgilfMg#mq#M6#+#b 


ty 


Good. 


! nx 


. 1 r "■ » 


fn 


kwo//5 


; wa 


#y#*#mx'#+#b 


ty 

( 

t 


This Is the generalization 
for a straight line. What 
would y and x be In the 
cost function T. Try again. 


un 


Hint; substitute C and g 
for y and x In the general 
equation for a straight 
line. 


un 


The correct answer Is 
c + mg + b . , 


br 


c17-3 



Sample Question 3> This question Illustrates another Im- 
portant variation of the keyword (kw) function. In numerical 
responses It Is often very Important that the key word elements 
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appear in the proper sequence. The system incorporates the func- 
tion called keyword order (kwo) which will check not only for 
presence of key words 9 but also for the order of , these ke^ words. 
Following the kwo function is the correct answer (ca) with which 

the function will compare the student’s response for processing. 

, : ■ , 

Delimiters must be used to separate the individual words or ele- 
ments considered to be words when the kw function is used. In 
this example the dollar sign has been used as a delimiter. Any 
characters which occur between dollar signs are considered to 

' I , ' ‘ ^ 

be one key word. It can therefore be seen that in this example 
there are eight key words of which the author is requiring only 
five. The student must respond with the following key words 
in the proper order regardless of whether they are uppercase or 
lowercase characters and regardless of whether or not spaces 
have been inserted between them -- c * mg + b. 

The student records for this question (Table 6.5) indicate 
that even with the planning done by the author, the students 
encountered considerable difficulty in responding correctly to 
this question. The author has provided for two unanticipated 
answers (un) and following the last one, which informs the stu- 
dent of the correct answer, the author has automatically branched 
the student to the next question. 






Table 6.5 
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Sampl e Question 4--£ngineer1nii Economics 



Sequence No * 



Label Og. Code Argument 

e9-7 qu What is the present value of 

the capital recovery plus 
return on investment of the 
second year of the sura-of- 
digits method of deprecia- 
tion?® 



nx 

fn ic//6 

ca $2783.03 

ty Correct, 

nx 



fn ic//7 

ca $2,783.03 

ty Correct. 

an Incorrect. The desired 

value is found by: 

ty $3127 (0.8900) = $2783.03 

ty Give the correct answer.® 

un Try again.® 

an The correct answer is: 

$2,783.03. Type $2,783,03. 

rd Read the last page of 

paragraph 05-09. Then 
press EOB.^ 



® Indicates a programed ribbon shift command which, causes^^ 
Student'S response to be typed in red. 
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Sample Question 4. This question lllustj'ates two 
estlng strategies: 1) ribbon shift to cause the student’s re- 

sponses to be typed In red and 2) initial character processihg 
for numerical responses. The author has under his control the 
color of the ribbon which will be used to type responses and 
material for the student. By providing a ribbon shift command 
at the end of each sequence which is to be typed by the system, 
the author can cause all student responses to be typed In red. 

The ribbon shift command consists of two Characters, one non- 
printing character Identified "prefix" followed by either a 
(meaning shift to red) or b (meaning shift to black). The argu- 
ment for question 4 Is followed by the non-printing "prefix" 
and the character a. The ty following the first un and the 
second un are both followed by the prefix a characters which 
change the ribbon color to red and give control of the terminal 
to the student. The ribbon shift feature Is also illustrated 
in the final un and in the following rd statement. In each case 
the student Is told to press EOB, which is the signal to the 
system that the student Is ready to proceed; and the EOB Is pre- 
ceded by a “prefix a" sequence and followed by a "prefix b" 
sequence." This causes the ribbon to shift to red before "EOB" 

Is typed and then shift to black for the following typing. This 
flexibility Is quite desirable when the author wants the student 
to type a particular response or to respond, in a particular, way. 
Authors have encountered problems occasionally when other teehniqui 
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were employed for Indicating a particular and specific response 
that' the student should make* For example* some authors have 
tried underscoring the particular response the student should 
make and others have tried enclosing that specific response in 
quotation marks. The results of these attempts were that if 
the author had underscored the answer, the student would under- 
score the answer; or if the author had enclosed the correct 
answer in quotation marks, the student would enclose hit response 
in quotation marks. In most cases, because of the inclusion of 
these extra characters, the response will not be accepted by the 
system as a correct response. The ribbon shift feature has the 
advantage of presenting the response exactly as it is to appear * 
except for color over which the student has ho control. 

The second Interesting feature of this sample question is 
the initial character (ic) function. The first 1c function 
specifies six characters which must match, this function is 
followed by the ca upon which it is processing. The fipure 6 
in the 1c fanction specifies that the system will match the stu- 
dent's response only to the first six characters of the stored 
ca. In this case it means that the system would ignore the last 
two characters, 03. The following 1c function specifies seven 
characters which must match. This function will also ignore 
the 03 (three cents) at the end of the response but allows the 
st.ident to include a comma separating the hundreds and thousands. 
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* Student records for this question (Table 6.6) indicate that 
it was' a relatively easy question for the students to answer 
and that the initial character functicn was operating to good 
advantage. 



Table 6.6 

Student Responses for Sample Question 4 
from CAI Engineering Economics Course 
Field Trials Summer 1966 






Student 

Number Trial 1 



Trial 2 



Trial 3 



0031 


$2783.03 


0028 


$2783 


0097 . 


2780 


0125 


$2374 


1035 


$2783.03 



1 ' f'' \ 



$2733.03 

2783.03m- $2783.03 

$2783.03 
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Sample Question 5»»Eng1neer1ng Economics 



Sequence No. label 


Op Code 


Arqument 


fl05-01-20 


rd 


f 




ty 


0 6 <"0 2 * 9 9 '' 


f2-l 


rd 


Read paragraph 06-02. 
(EOB) 


f2-2 


QU . 


The company described In 



paragraph 06-02 probably 
expects at least 10% 
return on Its Investment 
because: 

a. It can get at least 
this much In some 
other type of 
Investment. 

b. Anything under 10% 

would not be considered 
by management as 
enough return to 
justify the Invest- 
merit. .. , ; • 

c. Both « and b. 

d. Some other reason. ^ 

Answer aiS o, or d. 



fn kw//l 

ca ■ . # C 

ty Is correct. Both 4 

and b are very closely re- 

lated. Managemeiiv wHl 
probably not accept any- ■ 
thing under a 10% return 
if It can receive at least 
that much In some other 
Investment. 






o 

ERIC 









o 

RXC 



Sample Ousst'ion 6,. This question permits only One trial 
for a response and then reaffirms the ^correct answer by pro- 
viding the ty. The ribbon shift feature is used to emphasize 
the particular items which .must appear In the student’s responsO? 
Multiple choice questions have been found to be very useful 
in CAI inasmuch as the amount of typing that a student must 
do is reducedi this eliminates much frustration for some stu- 
dents and allows them to proceed smoothly through a course. 









Tabl'i 6.7 






student Responses for Sample Question 5 
from CAI Engineering Economics Course 
; Field Trial, Summer 1966 
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Results of Field Trial 

Table 6*8 presents the term in attendance* grade point 
average, and performance of students in the engineering economics 
field trial. Two essay tests were administered to the st^idents 
during the term. The scores on these were converted to T scores 
and an average T score was derived from the two independent 
scores. Table 6.9 presents the mean and standard deviations 
compiled from the average T scores for each group ii< the engi- 
neering economics field trial. A one-way analysis of variance 
on average T scores was performed. The results are shown in 
Table 6.10. 
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Table 6,9 

Mean and Standard Deviations for 
Lecture » Self-Study t and CAI. Groups 
Engineering Economics Field Trial 
Summer Term, 1966 
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Compiled from Average T-Scores 

Lecture 


it. 

Self -Study 




CAI 


Mean 47.18 


54.24279 




49.5 


S.D. 4.58220 


9.53628 




8.08649 



Table 6.10 

One Way Analysis of Variance on Average T-Scorej; 
for Engineering Economics Field Trial 
Summer Term, 1966 



Sources 

Groups 

Within 

Total 



Sum of 
Squares 



154.30600 

1150.36300 

1304.66900 



Degrees of 
Freedom 



2 



11 

19 



He an 
Squares 

77.15300 

67.66841 



1.14016 
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MODERN MATHEMATICS 

(C. Alan Riedesel and Marilyn N. Suydara--Cowrse Authors) 



The strategy of Instruction fon the modern mathematics 
( modmath ) program was b^ied on several /assumptions concerning 
the teaching-learning process. These wfere: 

' - ~ - , « ", ' V . 

1. Mathematics is best learned when students are 
encouraged to discover the bail c ideas* laws » 
or principles of mathematics. Thus* students 
should be given a chance to solve a new prob- 
lem themselves rather than first being “shown*' 
or told how to solve it 

2. The reason for studying a topic should be made 
clear by the manner in which it is introduced^ 

3. Individuals vary in their receptivity for 
learning. 

4. Effective learning is continuous and develop- 
mental in nature; thus* previous generaliza- 
tions and facts are helpful in developing new 
general izat tons ‘-'V,; /• 

5. Continual failure by an individual is not 
conducive for effective learning. 

Active participation by the student tends to ! 
produce an effective learning experience. 

7. Knowledge of one's progress contributes to . 
effective learning. 

A belief in these assumptions led to a teaching procedure 
tn which the student was presented with a problem that could 
be solved by his use of previous knowledge and his thouglitful 
discovery of the next step of knowledge in the subject. This 
approach could be called an inductive approach. A deductive 
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approach is ustsally used in programmed materials. The following 
diagram contrasts these two approaches to teaching mathematics: 



Inductive Approach 
Student is presented 



with a problem. 

If problem is solved 
by student, he is led 
to refine his proce- 
dure for solving 
problems of this 
type. 

Student is asked to 
develop a generali- 
zation. 

Student is quizzed . 
concerning aspects 
of the generaliza- 
tion. 



If student cannot 
solve problem, he 
is asked develop- 
mental questions 
which lead to the 
solution. Student 
solves similar 
problem. 



Deductive Approach 

student Is presented 
generalization. 

student is quizzed 
concerning aspects, 
of the generaliza- 
tion. , 

Student is pre- 
sented with illus- 
trative problems 
in which the pro- 
cess of solution 
is explained to him. 

Student applies the 
generalization to 
solving problems. 



Tin the modern mathematics C.AI course the use of a teaching 
technique similar to the inductive pattern was attempted. An 
illustration of such a pattern. for classroom use is as follows: 

Purpose of the lesson: To develop an understanding of the 

; . use of the inverse (reciprocal) in 

dividing rational numbers. 

The teacher stated: “We*ve been solving division problems 

involving the use of rational numbers in several ways. Now let 
us see if W can find a more efficient method of solution. What 
are vaHous ways lo wnic^ we can write 6 4 3/4?“ 

A. , ^ ^ 'V , ' *' V ^ ‘ v’ f 

Ha following Hays Were suggested by the ktudents: 



6 « 3/4 = N 



3 

?TT 



6 

T = n 
T 
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The teacher said: ’’Look at form (b) 3 . If we could 

, ■; .T 

reduce this fraction* we could solve the problem* What would 
be the denominator that would make reduction of the fraction 
simplest to perform?" 

Pupils suggested that the easiest fraction to reduce would 
be a fraction with a denominator of 1. The teacher asked: 

"How could we change the denominator from 3/4 to 1?" 

S^tudents recalled that by multiplying by the Inverse - the 



reciprocal of ,3/4* which Is 4/3 - the denominator would be 1* 
pupils then said that If the denominator was multiplied by 4/3, 
the numerator would also have to be mult Ipl fed by 4/3 (an applf 
cation of the role of. the Identity element for 



whi ch 



1 $ 1 . 



4 



fi another name for l,)> 















The resultant problem written on the chalkboard In the 



following form! 









4 





Students continued to work division problems In this man-ier for 
a time. When, the teacher felt that the students had a good 
understanding of thls^approach, discussion and guided questions 
were used to develop the Idea that It 1$ not actually necessary 
to write all of the material - actually, inverting thq divisor 
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accomplishes the desired result. Thus 

5 f j « 5 X I* » 10 

.' . ■•;■ .5 X J . 

A teacher using a deductive forraat for the teaching of 
inversion would have first explained the approach to the class 
and then had the students practice its use. 

Certain problems arose la applying the Inductive technique 
to the Writing of the modern mathematics course. In1tC.lly» 
to transfer a concept of an Ideal situation to a programing mode 
was difficult because of dealing with an Imaginary student. It 
was especially hard to anticipate student answers; the possibilities 
seemed Infinite at times. There was the tendency, therefore* 

-0 write a linear pattern with many multiple-choice items. The 
linear pattern save assurance that everyone would see the (some- 
times) clever things that had been written. The multiple-choice 
Item limited the student*s choice and therefore the difficulty 
of having to deal with the unanticipated when, by definition. 

It could not be anticipated. Parti al-asiswer processing functions 
helped to resolve this problem when they became avallablCv 
Another difficulty In a course designed primarily for future 
teachers was finding real life situations which made serise to 
adults and also which could be applicable at ah elementary level. 
Transfer to a real elementary classroom situation was essential 
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hapefiillyt the method by which the material was taught t& teachers 
would affect their owri teaching procedures. 

3om0 difficulty was met in determihing “size of steps** in 
asking the questions which led from one point to the r<ext. this 
invotyedc a value judgmentt and it was found that step size varied 
with the type of material. 

Determining the patterns of learning for various students 
was an even greater problem* amount of practice and remedial 

material, the type of vocabulary, the type of learning struc- 
- tn short, the needs of individual students - had to be 
considered. Some ^ranching opportunities sere provided on the 
basis of each of these vtriables and pore should be added as 

additibnaV student records arc ana : V 

Traditional materials provided litfle^r^^^ help except for 
basic content guides since they operate from a different frame- 
work . Heani ngful prohl em s 1 tuat 1 ons are general ly lacking i n 

them; deductive, rule-stating approaches are frequently use^d^^ 
there i$ta heavy emphasis on vocabulary rather than on cpncept- 
formatton. We visualized the best type of tedching-iearning 
situation, on the other hand, and tried to lead the student to 
discover concepts and broader principles* , 

We. felt because the system handicaps a student 

in being **creat1ve** - he has to conform to oar expectatipn of 
whst answei's were prohabifi* possible, and acceptable. Struc- . 
turing the program through an “inductive" or "discovery" approach 
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seemed vital to counteract* in part* this handicap. There was 
definitely a need for additional contacts with a teacher and/or 
ether discussion situations to allow questioning* even more In- 
ductive problem-solving* and creative thinking. 

Development 

The CAI modern mathematics course provides the background 
for understanding mathematical content and concepts of the sys- 
tem of real numbers and Its component systems* Including basic 
sei theory* varylfig numeration systems* operations* properties* 
and algorithms. The program was developed with reference to 
teaching In the elementary school. Appendix 6.1 contains an 
outline of the topics considered In the course. 

The breadth of the program proved to be a limitation - there 
was a great deal of material to program. The pressure produced 
by volume was compounded by time the need to complete the en- 
tire program within the specified number of months. Because 
of this pressure* much more of a Skinnerian or linear program 
(with comparatively few branches) resulted* and the potential 

of CAI was perhaps not fully utilized. 

However* a final outcome was a course which "runs" and from 
which students have learned. In fact» two parallel courses are 
available; one which Is Identified as mavmath has tape-recorded 
messages and random-access 2 x 2-1nch slides controlled by the 
computer (?.ee sample of program* Appendix 8.4) 5 the other iden- 
tified as modmath uses a book of static displays In lieu of the 
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tape messages and slides. The content of the two courses is 
identical f though much additional time was taken to insert the 
additional functions and to restate some directions for the may, " 
math program. 

While the details of the procedural steps used in developing 
the program differed for each chapter t they are approximated as 
follows; 

1.. Develop outline with the amount of detail 
differing with the topic. Use was made of 
two basic sources — Theor y of Ari thmeti c » 
by Peterson and Hashisalcil and Arithmetic , 

Its Stru cture and Principles , by Mue 11 e r - 
and many additional supplementary references. 

2. Delineate principal questions, which led to 
development of the content of the outline. 

3. Complete the writing, using Coursewriter 
instructions, branching to meet Individual 
needs. 

4. Reread, then rewrite; reread, then rewrite - 
generally tWvO or three repetitions of this 
were involved at this stage. Discussion 
between the authors was important here as 

at other stages. 

f 

5. ' Have program typed; reread for accuracy 

and make any changes apparently necessary. 

6. After the program is in the computer, at 
least one rereading is necessary, reading 
for errors in input and any other errors 
that were apparent; then rewrite, 

7. After students worked through a section, 
more revision was done with reference to 
their comments and answers, which were 
analyzed and evaluated. (Continuous 
evaluation and rewriting was, obviously, 
necessary!) 
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Meld Trial 



A description of a field trial of the modern mathematics 
CAI course is presented in an article (see Appendix H.2) written 
by the authors of the course and Is quoted here: 

"The course used in this study was programed on 
the basic mathematics content of Math 200, for fresh- 
men and sophomores in the elementary education sequence 
at PSU. In addition to the course text, other refer- 
ences were used as content guides in writing the pro- 
gram. The material was divided into fourteen chapters, 
with the following indicative titles: Sets; Relations; 

Exponents; Our Numeration System; Other Numeration 
Systems; Whole Numbers: Addition, Subtraction, Multi- 
plication, Division; Integers; Rational Numbers: Frac- 

tions, Decimals, Ratio and Percent; and Real Numbers. 

"The problem that was explored referred to the 
value of CAI ^ how does it affect the achievement of 
a group compared with the achievement of a group in 
the traditional class pattern? 

"The population - all freshman students in the 
elementary education and special education curricula 
at Penn State who were scheduled for Math 200 during 
the spring term of 1966 - were assigned to sections, 
at random, by a computer. From the four sections, 
one was selected at random. The 26 students in the 
section (all women) were pretested with a 40-item 
test of mathematical content developed by the authors 
(Kuder-Richardson Formula 20, r = .82); the results 
were used as a basis for selecting ten matched pairs 
of students. One member of each* pair was randomly 
assigned to the CAI-treatment group and one to the 
teacher-treatment group. 

"All students in the section met together for 
one standard 75-minute period per week for discussion 
that centered on their questions in regard to content. 

Both groups used the text Theory of Arithmetic , by 
Peterson and Hashisaki, and both were provided with 
the same study guides. The instructor of the course 
was co-author of the CAI program, and he used the same 
outline for the class as had been used in developing 
tbe CAI program. Both groups were considering the 
same topics each week. As . measure of control on 
outside-of-class practice, the answers to study guides 
were collected. 
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“The teacher-treatment group met twice a week 
for class periods of 75 minutes each o The instructor 
developed the mathematical content inductively, to 
parallel the premises of the CAI program* The CAI- 
treatment was scheduled for 2 1/2 hours per week on 
the computer, equivalent to the time spent by the. 
teacher-treatment group. Instruction and testing 
occurred within a standard ten week term." 

Several analyses of the program have been made. Table 7.1 
shows the structure and amount of course material stored in the 
computer for the mavmath program. Table 7.2 shows the time 
spent on computer terminal by the students In the modern mathe- 
matics course. Table 7.3 shows the character and operand code 
count for five representative, selected questions from the course 
( mavmath ) . On the basis of the Information from these five ques- 
tions, it is estimated that for the 1191 questions and related 
instructions In the course, there are approximately 642,816 
characters In computer storage for the 14 chapters. 
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Table 7.1 

Structure of CAI Hodern Matheinatics Course 
Field Trial, Spring 1966 



Chapter 

No. 


No. of 
Courseuriter 
Instructions 


No. of 
Qu’ s 


No. of 
Slides 


No. of 
Tape 

Recorded 

Messages 


1 


642 


66 


21 


22 


2 


510 


55 


6 


1 


3 


in 


44 


5 


. 6 


4 


243 


22 


4 


4 


5 


1377 


139 


25 


^•7 


6 


1466 


143 


39 


35 


7 


1116 


119 


30 


10 


8 


1132 


118 


33 


9 


9 


1017 


102 


24 


8 


1 A 
1 V 


642 


CM 


10 


2 


11 


1200 


127 


10 


5 


12 


661 


64 


10 


0 


13 


663 


55 


19 


7 


14 


745 


65 


22 


12 


p 

Total 


11765 


1191 


258 


138 



\ 
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Table 7.2 

Time Spent on Instructional Terminal by 
Students in the Modern Mathematics CM Group 
Field Trial, Spring 1966 



Student 

Number 


Dates 

Beginping-Ending 
1966 . 


Time, .. 
Hours-Minutes 


Average 

Hours/Week^ 

Hours-Minutes 


0030 


4/9 - 6/10 


17 


10 


1 


54 


0031 


4/9 - 6/8 


24 


31 


2 


43 


0032 


4/9 - 6/8 


28 


50 


3 


12 


0022 


4/6 - 6/8 


29 


27 


3 


16 


0024 


4/7 - 6/6 


29 


26 


3 


16 


0029 


4/12 - 6/8 


29 


41 


3 


18 


0028 


4/7 - 6/3 


21 


6 


2 


19 


nn9K 


4/7 - 6/6 


24 


45 


3 


41 


0023 


4/7 - 6/3 


27 


9 


3 


1 


0033 


4/9 - 6/7 


27 


33 


3 


4 


Total time - 


259 hours and 28 


minutes 








Average time 


per student - 25 


hours and 


53 minutes 





^Calculated on the basis of maximum number of weeks (nine) on 
terminal by student from the group. 













# 

( 1 ) 

m 

►- 




(/> 

c 

0 

•p* 

+» 

0) 

3 

O' 

•a 

0) 

•M 

c 

01 

0) 01 
(O u> 

&. 

0> 30 

> oo 

•r“ O CT> 

Un P“ 

lA 

u o at 

O *P" c 

(0 &. 
•P E O. 
C 0)CO 
3x: 

o+» •* 

0 «0r— 

£ (0 

01 

*3 C &. 
O &-H 
O Qi 
•0*0 
T3 O r— 

c ac 0 ) 

lO •!- 

(. E 'u. 
0) o 

O.S. 

o «♦- 
•o 
<0 

&. 

0 } 

p 

u 

(0 

u 

(0 

x; 

o 



•— s- VI 






























<0 C 3 




1— 


r— * 


ict 




CM 




00 


CM 


CM 




_..r> 


to 


CO 


PJPO 




CM 


09 


00 




VO 




CM 


r* 


r“ 




VO 


o 


l>* 


O 








iO 




fmm 












CO 


CM 


CO 


S— CJO 






















• 






CM 


!•*> Sm tA 
(0 0 3 
P «PO 




r” 


If-* 






VO 






rv. 






VO 


a%\ 


CM 


o 

h- *♦- LO 


























1 




to 








<T» 










fN. 


VO 




VO 


CM 




O 








O 




CM 








V* 




CM 


CM 


r-* 


• 








»— 




















CM 


(/> 






























0) 






























3 




























0«P 








r- 




fmm 






r“ 


fmm 




»— 


•-I 


1 VO 


<• 












lO 








VO 




VO 


cmI 


1 O 


o 








O 




CM 






CT> 


r“ 




CM 


CM 


at 


• 








CO 










r“ 










1 to 


(/> 






























01 






























3 

04- 








r— 










CM 






»— 


f—1 rs. 


CO 








OI 




r“ 




00 




CM 




cr> 






u 








VO 








CM 


VO 


CO 




•M* 




CM 


• 
























CM 






(A 






























0) 






























3 

04- 








»— 




fmm 




»— 


r» 


CM 




CM 


CM 


1 O 






























1 »— 


CsJ 








CO 




o 








CM 




VO 




on 


o 








O 




ID 






CM 


CO 




VO 




1— 


Ques. 

f 








CM 










CM 










VO 

1 . 








r— 




CM 






fmm 


CM 




CM 


































1 •- 


•ft 

•-••ft 












CM 






o 


VO 






CO 


CO 


o 

• 




CM 


00 






CM 






to 

fmm 


fmm 










(/> 






























o 






























34t 

04- 






l-=» 






r“ 






CM 


fmm 


• 




col oi 
































O 






























•3 


&. 




























o 


(0 




c 
















s. 






-J 


ct 


E 


•o 


•a 


3 


o 


<0 


JQ 


(0 


C 


X 


O 


>> 


c 






•r- 




u 


o* 


•o 


u 


U 


2 


3 


c 


c 


P 


4- 


1- 


O. 


s. 








(0 












•r- 






o 


o 


a. 








s 












s 






|«M» 



(/> 

&. 

0 ) 

p 

u 

<0 

f9 

o 



>><♦- 
Q O 
c 

01 s» 

3 0) 

crx> 
3 E 
&. 3 



* * 




rc!rr“ 



125 



The entife question and related materials for each of 
these sample questions is presented on the following pages* 
Following each question and related material is a table which 
shows the attempts which ea^h student made to answer that 
question* 

This field trial was conducted on the 1410 computer located 
at the Computation Center on Penn State Campus and because of a 
transition from one system to another, some data which are 
normally available from student records were not available 
for this field trial. 
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Sample Question J[--Modern Hathematics 

Sequence No , 

06-0300-226 



Label 


Op Code 


Argument 


6-45 -8 


rd 






fn 


sl1de//12 




fn 


wa1t//10 


6-45-c 


qu 


Now analyze the table, 
addition In this system 
commutative? 




nx 






fn 


kw//2 




Co 


y es 




un 


Check each combination. 
Then answer the question 
again . 




un 


Addition Is commutative 



0 

0 

0 



D 

0 

Q 



Is. Question 1, Slide number 12 Is presented to the 
student and the system waits 10 seconds for the student to ex- 
amine the slide. The question Is typed for the student and the 
system waits for the student to respond. A stored correct re- 
sponse “yes" will be processed by a keyword (kw) function. Spaces 
have been used as delimiters In the correct .response which seg- 
ments the word yes Into two words? the first consisting of “y" 
and the second consisting of “es.“ The keyword function ex- 
amines for two responses. This procedure allows the author to 
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0 

0 



o 

ERIC 
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ignore uppercase or lowercase letters as part of the response. 
The response will be counted correct whether or not It has been 
capitalized. 



Table 7.4 

Student Responses for Sample Question 1 
from Modern Mathematics Course 
Field Trial, Spring 1966 



student 

Number 


Trial 1 , 


Trial 2 


Trial 3 


0022 


yes 






0023 


yes 






0024 


no 


yes 




0025 


no 


yes 




0028 


yes 






0028 


yes 






0030 


yes 






0031 


yes 






0032 


yes 


no 


yes 


003./ 


yes 










|er|c 
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Sample 2--Modern Mathematics 



Sequence No . Label Op Code 
08-0600-010 8-43 qu 



nx 

fn 

ca 

ty 

nx 

fn 

ca 

ty 

un 



Argument 

After multiplying the sum 
of the raised fingers by 10 
and finding the product of 
the closed fingerSf what two 
numbers are added when you 
are using the finger method 
to solve 6x6? 



kw//3 
.20. + .16 
Correct. 



kw//2 

.20.16 

Yes, 20 is added with v6> 

One finger iJ* raised on each 
hand; 10 (1 + 1) “ 20. Four 
fingers are closed on each 
hand; 4x4= 16. Therefore 
we will add 20 + 16. Type 
20 + 16. 



Sample Qu estion 2. Keyword functions are again used in 
this question to examine specific elements Vv’hich should appear 
in the student*s an&v^er without regard to order, spacing, or 
punctuation. Periods have been used as delimiters to separate 
the three keywords in the two functions. 
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Table 7.5 

Student Responses for Sample Question 2 
from Modern Mathematics Course 
Field Trial, Spring 1966 



Student 

Number 


Trial 1 


Trial 2 


0022 


1 and 1 


20 + 16 


0024 


20 + 16 




0025 


20, 16 


20 + 16 


0028 


10 + 16 


20 + 1^ 


0029 


The product of the raised 
fingers with the product 
of the closed fingers. 


20 + 16 


0030 


20 + 16 




0031 


20 f 16 




0032 , 


1 . 


20 + 16 
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Sample Question 3--Modern Mathematics 



Sequence No. 


Label 


Op Code 


Arqument 


09-Q730-020 




qu 


How do you know if a number 
is divisible by 3? 






nx 








fn 


kw//4 






ca 


.sum. digits .divi .3. three 






ty 


Yes 



nx 

fri kw//2 

wa .multiple. 3 

ty A number is divisible by 

3 if there is a multiple of 
3 in the ones place. Con- 
sider, however, 42 and 135. 
Both are divisible by 3, yet 
there is no multiple of 3 
in the ones place. Now answer 
again. 

un Consider the sum of its 

digits. Try again. 



Sample Question 3. This question is a very good example 
of processing free-form responses made by the student. The 
auv:hors have included five key words in the first ca processed 
by the preceding keyword function which is seeking four correct 
words. Four of the five key words must appear in the correct 
answer without regard to order. Notice that the authors have 
used only a segment (divi) of the word "division" or "divide" 





1 



to allow flexibility in the form which the student might use 
in responding. The authors have also used the numeral “3" or 
"three" to allow added flexibility In responding. It Is Inter 
esting to note In Table 7.6 the diversity of responses which 
hiSve been counted correct by the author and the system. 
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0032 Multiple of three 1 Equal three or 

multiple 

0033 If the sum of its digits Not equals but is The sum of its digits 

equals three divisible by three is divisible by three 




Table 7.6 (cont'd.) 

Student Responses for Sample Question 
from Modern Mathematics Course 
Field Trial;, Spring 1966 
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Sample Question 4— Miadern Mathematics 



Sequence ^o. 


Label Op Code 


Arqument 


09-0770-020 


qu 


What digit which makes the 
number divisible by 9 can 
be put in each blank? (Type 
the missing digits in order, 
with a comma between each.) 
7843 30 7 1156 91 

811JJ23 




nx 






fn 


kw//4 




ca 


.5. 8. 4, 6 




ty 


Good! 




un 


The missing digits must make 
the sum of the digits in 
each case equal to a number 
divisible by 9. Try again. 




un 


The missing digits are 5, 8, 
4, 6. Type this. 


Sample Question 4. This question again uses the keyword 



Mrwi function to orocess the student's responses. It Is apparent 

^ •v/ • 



^rom Table 7.7 that the program has reasonably good control of 
student responses. Student 0029 "signed off" when he was pre- 
sented with this problem the first time and did not attempt 
the response until he “signed on" the following day. 
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Table 7.7 

Student Responses for Sample Question 4 
from Modern Mathematics Course 
Field Trial, Spring 1966 



Student 








Number 


Trial 1 


Trial 2 


Trial 3 



0022 

0023 



0024 



0025 

0028 

0029 

0030 
p031 

0032 

0033 



5 , 8, 4, 6 
5, 8, 4, 0 

5, 8, .4, 6 
5 9 8, 4, 6 
2 , 2 , 1 , 0 
Off 

5, 8, 4, 6 
5, 8, 4, 6 
4, 8, 4, 6 
3, 8, 4, 6 



I don't understand 
what I'm am doing 
wrong 



5, 8, 4, 6 
5, 8, 4, 6 



5, 8, 4, 6 

6, 8, 4, 6 



5 , 8 , 4 , 6 



5, 8, 4, 6 



. o 

ERIC 
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Sample Question 5->-Modern Mathematics 



Sequence No , 
11 - 1020-020 



Label Op Code 
qu 



Arg ument 

' \ 

Consider 2/7 x 3/5, Note 
youir procedure as you find 
the solution. What is 
2/7 X 3/67 



nx 

fn kw//3 

ca .6 ./ . 35 

ty Correct 

un 2/7 X 3/5 « (2 x 3)/{7 x 5) 

6/35. Type 6/35, 



Sample Q uestion 5. This question again uses the keyword 
(kw) function for processing the responses without requiring 
specific spacing or punctuation. Table 7.8 indicates again 
that the program has very close control of student responses 
to this questionc 






Table 7.8 



Student Responses for Sample Question 5 
from Modern Mathematics Course 
Field Trial, Spring 1966 





student 

ilumber 


Trial 1 


Trial 2 



0022 


6/35 




0023 


6/35 




0025 


31/35 


6/35 


0028 


6/35 




0029 


5/35 


6/35 


0030 


6/35 




0031 


210/35 


6/35 


0032 


31/35 


6/35 


0033 


6/35 
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CHAPTER VIII 

SUMMARy OF PRELIMINARY STUDIES AND FIELD TRIALS 



During the course of the project, approximately 97 P nn 
State students completed sections of the four CAI courses. The 
total group of students may he divided into two subgroups of 30 
and 67. The computer time used student instruction amounted 
to approximately 576 hours during the field trial. 

The first subgroup was comprised of those students who ex- 
perienced an entire CAI sequence for academic credit during the 
field trial of the four courses. The details of the field trial 
are reported in chapters IV (Audiology), V (Management Accounting), 
VI (Engineering Economics), and VII (Modern Mathematics). How- 
ever, the total use of the Laboratory for the field trial for 
all four courses is summarized in Table 8.1. 

The other subgroup of 67 students were involved with the 
project before the completion of the four courses. 

Forty-seven students were used to help test courses early 
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criterion measures. For this group, the variables available for 
analysis were. 

1. Self-report ratings of reactions to CAI 

2. Student errors in CAI courses 

3. Rate or speed of performance on course material 
Scholasti c Aptitude Test scores (SAT) 




4. 



uo 



Table 8J 

Time Spent on Computer Terminals by Students 
in the CAI Groups for the Field Trial 
of Four College Courses 



Course 


No. of 
Students 


Total 

Time 

hrs/mins 


Maximum 

Time 

hrs/mins 


Minimum 

Time 

hrs/mins 


Average 

hrs/mins 


Speech Pathology 
and Audiology 


4 


63 


48 


19 


24 


11 


49 


15 


57 


Hanagement 

Accounting 


10 


181 


0 


26 


8 


9 


10 


IS 


6 


Engineering 

Economics 


6 


71 


54 


17 


6 


9 


23 


12 


0 


Modern Mathematics 


10 


259 


38 


29 


41 


17 


10 


25 


58 


Totals 


30 


576 


20 










18 


25 



5. Cumulative grade point average 

6. Scores on the Penn State entrance examination battery 
and various subtests 

7. Scores on the Bernreuter Personality inventory adminis- 
tered to entering f re slime n at Penn State 

For the second group of 20 students* measures of achievement of 

course content and retention were obtained in addition to the 



above variables. 
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Reactions of Students to CAl 

Of the first 47 students, 18 worked in audiology, 21 in 
cost accounting, 7 in modern mathematics, and 1 in engineering 
economics. The results fall into three general categories: 

1) mean student self-reports of reactions to CAl, 2) selected 
correlations among a number of student variables and performance 
in CAl, and 3) impressions obtained from guiding students through 

the courses and from informal interviews with students following 

" . ■ ' ' ' ' • * . 

their experience with CAl. TLa results should be regarded as 
tentative and suggestive cf hypotheses for further study under 
highly controlled conditions. The 47 students were the first 
pilot group to test the CAl courses. They are not a random sam- 
ple of college students, nor were they assigned at random to the 
four courses. Frequently the students were used to help "debug" 
the courses, and problems were encountered by the student which 
would not ordinarily occur with a finished course. In addition, 
these early results are primarily of a correlational and descrip- 
tive nature with the accompanying difficulties of determining 
the direction of causation. In spite of the above H.^Hations, 
there appear to be some meaningful differences among the scales 
of the student reaction inventory, and some clusters of inter- 
correlations which "make sense" and support our subjective im- 
pressions. 

Following his first session of CAl, each student completed 
a Student Reaction Inventory consisting of a number of ocal.es 
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modeled after the Semantic Differential (Osgood et al^, 1957). 

The student reaction Inventory developed for this Investigation 
appears In Appendix C.l. The extremes of each scale are defined 
by pairs of bl-polar adjectives such as good-bad, dull-interesting, 
tense-relaxed. Thirty-one students completed the reaction in- 
ventory (the first 16 students were taught prior to the develop- 
ment of this device). 

A profile of the mean ratings on twelve attitude scales 
was constructed for the total group and separately for each 
course. This profile Is shown In Figure 3. An examination of 
the high points on the profile of student attitudes toward CA* 
Indicates that students found the experience highly Interesting, 
good, fair, valuable, and active, and that the students reported 
being able to give the machine more attention than a traditional 

classroom lecture. 

That students react favorably to a new and novel instruc- 
tional technique such as CAI Is reassuring, but not particularly 
surprising. The low points In the profile of student reactions 
may be of greater Importance In pointing the way to Improvements 
In the Instructional system and toward new Instructional strate- 
gies. The three lowest points In the profile Indicated that 
the students reported being relatively tense as opposed to relaxed, 
they reported the program to be Inflexible, and that they missed 
opportunities for discussion. Fifty-four per cent of the sample 
reported being “slightly tense" during the first session of CAI. 
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Missed 
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We have no decisive data at present to indicate whether the 
reported tension had a positive or negative effect on student 
achievement and retention. It appears that some students are 
simply highly motivated to do well in the course, while others 
get “flustered" by the machinery. 

The student self-reports seem to agree with informal obser- 
vations of students working at the terminal. Some students seem 
“machine shy“ during the first hour of instruction, and comments 
such as "I'm afraid I'll do something wrong," or “I'm afraid 
I'll break the machine," are quite common. Students usually 
report being wore relaxed at the end of the first session of 
instruction than at the beginning. Other students seem to be 
in awe of the equipment during the first few instructional ses- 
sions. Several students who were personally observed by the 
writers became so engrossed that they forgot to follow a simple 
direction which had been stated some fifteen times in the pro- 
gram. These observations have led us to consider the need for 
longer warm-ups or an introduction to CAI which would prepare 
the student for instruction. 

The report of program inflexibility seems to have resulted 
from the requirements of an earlier CAI system which required a 
perfect correct answer match. Answers which were essentially 
correct, but differed in some trivial character (frequently un- 
noticed by the student such as spaces, upshifts and downshifts, 
etc.), were judged incorrect by the machine. A computer which 
will not ignore trivial characters such as commas, periods. 
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spaces, etc., and correctly evaluate a correct answer is judged 
Inflexible by students. These reports emphasize the need for 
partial-answer processing in CAI systems. It is anticipated 
that the ratings of future groups of students will indicate 
greater course flexibility as more of the functions permitting 
parti al -answer processing are incorporated into the courses. 

Students also rated the machinery as quite "fast.“ This 
reaction raises the question of rapidity of CAI. CAI frequently 
appears to qualify as an instance of massed practice. Although 
the system is in theory student-paced, the Immediate presenta- 
tion of the next question following a correct answer tends to 
'•force feed" the student. A study is presently underway to in- 
vestigate the effects of student-controlled pauses in the presen- 
tation of the course. Unfilled delays might provide time for 
students to process information and to rehearse their responses, 
and might be especially valuable following the correction of 
an error. 

Correlations among Se lecte d Student Variables , 

Reacti ons to tAi and CAi~~^¥rf ormance Vari abl es 

A missing data correlational analysis of a matrix of vari- 
ables including student errors, rate of performance, SAT scores, 
cumulative grade point average, Bernreuter personality scales 
administered to all entering freshmen at Penn State, student 
reactions to CAI, etc., was prepared. The analysis was performed 
for the total group of 47 students and separately for students 
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In audtology and cost accounting. Keeping in mind the dlffl-^ 
cultles of a posteriori "data snooping," the writers examined 
the matrix In an attempt to find nonchance, meaningful clustery 
of correlation coefficients. The results reported here are those 
which in 'the judgment of the writers seemed to tie together. 

Although there are probably few Individuals working In CAI 
who question the educational advantages of partial-answer pro- 
cessing, some of the present results make quite clear the prob- 
lem of the nonmatched correct answer from the student's view- 
point. (The present data were obtained prior to the availability 
of partial-answer processing.) In scoring the student's record 
for errors, It was necessary to distinguish between legitimate 
content errors and what were called correct answers, entered 
In wrong form, which were regarded as Incorrect by the computer. 
The mean per cent content errors based on the students' total 
number of responses for all courses was 20 per cent while the 
mean per cent correct answers entered In wrong form was 17 per 
cent. The correlations between the two types of errors were 
positive and significant at less than the .001 level for the 
total group and within each course. This correlation reflects 
the fact that the student types In the correct answer In wrong 
form, tries the same answer once or twice more just for good 
measure, and then discards his original correct answer for an 
Incorrect response, thus making a content error. Some perslsvent 



students may type In their original correct answer again and 
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When numbers of questions nfere used as the base for com- 
puting the percentage of errors > several students exceeded 100 
per centr An additional problem Is that these persistent stu- 
dents may be the self-sufficient students, and the system is 
negatively reinforcing self-sufficient behaviors. The Bern renter 
Stability and Self-sufficiency scales correlated significantly . 
and positively with the percentage of correct answers entered 
In wrong form (.43 and .56 respectively). The manual for the 
Bern renter describes the measure of self-suffivciency as follows: 
“Persons scoring high on this scale prefer to be alone, rarely 
ask for sympathy or encouragement, and tend to Ignore the advice 
of others. Those scoring low dislike solitude and often seek 
advice and encouragement.” 

Although the problem of correct answers in wrong form can 
be minimized by specific instructions to students at the begin- 
ning of a course or by inserting additional correct answers, 
some wrong form errors result from typing habits and poor punc- 
tuation. A correlation of .35 (P < .05) between the number of 
lines of program covered by a student per hour and a Punctuation 
subtest score on the Penn State entrance examination was obtained. 
Furthermore, a negative correlation of -.26 approaching signifi- 
cance between Punctuation scores and percentage of wrong form 
errors was also obtained. Recently, a small group of sight stu- 
dents was administered an achievement test after completing a 
section of audiology. Just one or two “bugs” in the program. 
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particularly of the correct response-wrong form type$ seemed 
to produce much interference and large decrements In student 
learning. These results emphasize the Importance of exposing 
studeirts^to a smooth-running CAI course. The partial -answer 
functiotrs described earlier In Appendix A.l alleviated the 
problem of requiring a student to match an anticipated answer^ 

exactly. 

The correlations In Table 8.2 (shown for the total group 
and cost accounting In parentheses) generally Indicate that 
students having lower cumulative grade points and scoring lower 
on the entrance battery tended to rate the course and machine 
as “fast." The correlations of several subtests from the Penn 
State entrance battery with percentage of content errors are 
suggestive of a similar negative relat1onsh1p9 although they 
are less consistent. These data are Indicative of the Impor- 
tance of the speed factor and suggest that courses employing 
optional delays, optional review, and optional remedial work 
would be beneficial for some students. 

Performance of HI gh and Low Apti tude 
Students In CAI 

The second pilot study employed a sample of 20 volunteer 
students from Introductory educational psychology classes. 

The sample consisted of 12 high aptitude S^s and 8 low aptitude 
Ss as measured by the Scholastic Aptitude Test. High and low 
aptitude was defined as the upper and lower 25 per cent of the 



U9 

distribution of verbal SAT scoreso The test had been administered 

to the students upon entrance to the University. The performance 

* 

of this group of Ss was studied in a much more systematic manner 
than that of the initial group of 47 students. 

Each subject was scheduled for three sessions at the CM 
Laboratory. During the first session, the S. was given a warm- 
up at the instructional terminal in the early afternoon of the 
day he was scheduled to participate in the experiment. Previous 
experience with students suggested that some warm-up to give 
the student practice operating the instructional terminal was 
extremely important. The student was allowed to warm-up on a 
short section of the modern mathematics course on elementary 
set theory. During this period a graduate assistant worked with 
the student at the terminal to clear up any questions or prob- 
lems he might encounter. A set of directions was also read to 
the student explaining the general nature of the experiment. 
Immediately following the warm-up period, the student was admin- 
istered a pretest to measure his previous knowledge of the sub- 

■t . . 

ject matter area in which he would be given instruction that 
same evening. Later the same day at approximately 6:30 p.m., 
the student returned for instruction via CAI on a section of 
the modern mathematics course designed to teach number systems 
with bases other than ten. Portions of the modern mathematics 
course are shown in Appendix G.4. Immediately following instruc- 
tion at the terminal, the student was given an alternate form 
of the pretest designed to measure his achievement of course 
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Table 8.2 

Correlations among Som Cognitive Measures, Reactions 
to the Speed of CAI i and Pereentage of 
Content Errors (n- = 21) 








Penn State Entrance Exam 


Subtests (Mooro-Caster) 


, 


C.C.P.A, 


Vocab. 


Paragraph 

Reading 


Spelling 


Pune. 


Total 


Rating: 














Course 

Fast 


-;15 

(-.50)** 


-.27 

(-.51)** 


-.33 

(-.29) 


-.14 

(-.43)* 


-.08 

(-.12) 


-.30 

(-.37) 


. Machine 
Fast 


-.35* 

(-.69)** 


-.37* 

(-.44)* 


-.37* 

(-.49)* 


-.31 

(-.46)* 


-.11 

(-.24) 


-.32 

(-.38) 


Per cent 
, Content 
Errors 


.13 

(-.12) 


-.20 

(-.36) 


-.11 

(-.27) 


.06 

(-.48)** 


.08 

(-.30) 


-.26 

(-.45)* 



* P<.10 

** P < .05 



content (hereafter referred to as posttest 1), and was asked 
to fill out the Student Reaction Inventory^ . The student returned 
exactly one week later for session three and at that time took 
another form of the achievement test (posttest 2) as a measure 
of retention. Due to an error in procedure, some students were 
administered posttest la second time while others were given 
the pretest again as the posttest 2 measure. The original in- 
tent was to use the pretest as the delayed retention measure 
to minimize direct recall of responses given to items in the 
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test. An examination of the students given the different forms 
of the achievement test as posttest 2 shows no differences in 
their performance as a function of the form of the test used. 

Reliability of the Achievement Measures 

As mentioned previously, an important aspect of research 
on CAI is the development of good achievement tests and other 
criterion measures to evaluate the outcome of such instruction. 
Seveiral short achievement tests were developed in the present 
project: one to measure achievement in the audiology course, 

and two alternate forms of a test to measure achievement in the 
use of number systems with bases other than ten. Each form of 
the modern mathematics test was 23 items in length. Reliability 
of the test was evaluated by means of the Hoyt analysis of 

variance technique (Hoyt, 1941). 

The analysis of variance summary for the sample of 20 stu- 
dents on Form B is shown in Table 8.3. The reliability of the 

test as estimated by the formula = I - o', between IT 

shown directly beneath the table to be .93. 

Since the subjects in the present sample were selected as 

extreme high and low aptitude groups, the possibility exists 
that the above reliability coefficient is spuriously high due 
to the exclusion of students of average aptitude. In order to 
check this possibility, separate estimates of reliability were 
obtained within the high aptitude and low aptitude groups. If 
the range of scores on the achievement test had been sevMously 
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Inflated by using extreme aptitude groups » one would expect the 
reliablUtles computed separately within the restricted range 
of high and low aptitude groups to be substantially lower than 
the reliability for the entire group o 

Tables 8.4 and 8,5 show the analyses of vairlance estimates 
of reliability for the 12 high aptitude students and 8 low aptl- 
ude students respectively. As can be seen from the tables, the 
reliabilities were .92 and .94 for the high and low SAT groups 
respectively Indicating that the use of extreme groups had no 
effect on the reliability estimate for the achievement test. 

Table 8.3 

Analysis of Variance Reliability of Form B 
of the Modern Mathematics Achievement Test 
for the Total Group of 20 Students 

- ' ' I * 

Source SS df MS 

Between £s 39.52 19 ,2.08 

Within Ss 67o65 440 

llol7 22 .51 



Items 

Residual 



56.48 



418 



.14 



Table 8.4 



Analysis of Variance Reliability of Form B 
of the Modern Mathematics Achievement Test 
for the Group of 12 High SAT Students 



Source 


SS 


df 


MS 


Between Ss 


18.98 


11 


m t'i 

1 . A O 


Within Ss 


37.83 


264 




Items 


5.98 


22 


.27 


Residual 


31.85 


242 


.13 




^tt ° " 1.73" 


•92 





Table 8.5 



An^alysis of Variance Reliability of Form B 
of the Modern Mathematics Achievement Test 
for the Group of 8 Low SAT Students 



Source 


SS 




MS 


Between Ss 


16.15 


7 


2.31 


Within Ss 


29.83 


176 


A. 


T terns 


9.98 


22 


.45 


Residual 


' 19.85 


154 


.13 
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The prior reliabilities reflect a high level of internal 
consistency of the test. Some evidence on the stability of 
performance on the modern mathematics achievement test is avail- 
able from the correlation between the posttest 1 and posttest 2 
administrations over a one wgek interval. The latter correla- 
tion was .93. Owing to a highly restricted range of scores on 
the pretest (students showed very little prior knowledge of 
number systems with bases other than ten), no meaningful corre- 
lations between the pre- and posttests could be computed. 

Results 

The results are reported in the form of two analyses. The 
first analysis shown in Table 8.6 shows t tests comparing the 
means of the high versus low SAT groups on a number of perform- 
ance and attitude ratings. The reader should note that the series 
of t tests reported in Table 8.6 is not the most ideal statis-. 
tical analysis for these data since ^ome of the dependent ve^'ia- 
bles are correlated and thus provide partially redundant infor- 
mation. Owing to the small samples of subjects and the prelimi- 
nary nature of the data, appropriate multivariate analyses were 
considered uneconomical at the present time. A correlational 
analysis was also computed showing some of the same relationships 
shown in the table of t tests and, in addition, relationships 
between a number of other variables. The results of the corre- 
lational analysis are shown in tables 8.7 and 8.8. 
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The results of the t test analysis generally indicate that 

» ' » » 

the high aptitude group peirformed better and had isore positive 
attitudes toward CAI than the low aptitude group. Although the 
groups differed significantly on the pretest, the mean perform- 
ance of both groups was less than one Item correct out of 23. 

It can be concluded that the students In the sample had very 
little prior Information about number systems with bases other 
than ten. Although the posttest achievement scores and other 
performance measures were not significantly different for the 
two groups, every difference was In the expected direction. The 
high SAT group had higher mean achievement posttest scores and 
lower mean number of errors, less time to complete the material, 
and fewer remedial questions than the low SAT group. In general, 
the high aptitude subjects evidenced more positive attitudes 
towards CAI than the low aptitude subjects. The mean ratings 
for the high SAT Ss were more positive than those of the low 
aptitude Ss on 12 of the 13 scales. The statistically signifi- 
cant differences Indicate that the high SAT group had higher 
means than the low group on the scales Bad-Good, Unfair-Fair, 
and Difficult-Easy (as might be expected). The low group also 
reported that they more frequently missed opportunities for dis- 
cussion during Instruction at the CAI teaching terminal. The 

most likely Interpretation of the differences In attitudes of 
the high and low aptitude groups 1s that poorer performance pro- 
duces more negative attitudes toward the Instructional method 
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Table 8.6 



Comparisons of High and Low Aptitude Groups 
(as Measured by the SAT) on CAI Attitude 
and Performance Variables 



Variable 


Low 

SAT (n*8) 
X 


High 

SAT (n«12) 
X 


» 'f ' 

t 


' y 

P 


Pretest 


0.12 


0.83 


+ 2.20 


.05 


Posttest 1 


12.0 


16.50 


+ 1.49 




Posttest 2 


13.6 


15.9 


+ .70 


* ’ 


SAT V 


420.9 


607.5 


+10.90 


.001 


SAT M 

i 

Ratings of Course: 


479.3 


541.5 


+ l.Si 


.10 


Fast 


3.9 


4.0 


+ ,14 




Interesting 


5.2 


5.3 


+ .10 




Relaxed 


3.6 


4.8 


+ 1.08 




Good 


3.5 


5.2 


+ 2.14 


.05 


Fair 


3.8 


5.9 


+ 2.42 


.05 


Deep 


4.8 


4.3 


.51 




Valuable 


4.4 


5.1 


+ .80 




Acti ve 


4.5 


4.9 


+ .43 




Easy 


2.2 


4.4 


+ 2.85 


.02 


Flexible 


3.2 


4.3 


+ 1.53 




Machine Fast 


4.6 


5,3 


+ .67 




More attention 


to machine 


4.0 


6.1 


+ 1.66 




Did not miss oppor-> 
tunitles for 






> - 


.05 


discussion 


3 . 1 


5.5 


+ 2.21 


Total Errors 


35.0 


24.2 


1.36 




Content Errors 


30.6 


21.2 


1.37 




i-urm Errors 


4.4 


3.0 


1.08 




Mean Time 


206.1 


179.5 


1 *1 3, 




Mean No. Remedial 


Questions 


53.5 


48.9 


.45 






157 



regardless of what siethod Is being used. Since aptitude corre- 
lates positively with performance in the course, the differences 
in mean ratings cannot be attributed to aptitude alone. Results 
from the correlational analysis support the interpretation that 
poor performance produced the negative rating rather than the 
other way around. 

A comparison of the mean posttest 1 and delayed posttest 2 
scores indicates that no forgetting took pla^e over the one week 
interval. The total group mean for posttest 1 was 14.7, while 
the mean for the one week delayed test was 15.0. Tiie retention 
evidenced after one week is probably a function of the nature 
of the learning task used in the study. Manipulating number 
systems with bases other than ten involves learning a set of 
principles which, once mastered, are probably not easily for- 
gotten. In fact, the principles learned are the same principles 
used implicitly ly all students in working with the base ten 
or decimal system. Once the student learns to apply the rules 
with number systems having bases other than ten, his vast ex- 
perience with the decimal system most likely facilitates reten- 

ti'bh. ■ * ' ■ ' ■ 

table 8.7 shows the matrix of intercorrelations for the : 
Scholastic Aptitude Test Scores and the CAI performance measures. 
It should be remembered that the use of extreme groups on the 
aptitude measure would tend to inflate correlations over what 
would be obtained if the entire range of aptitude scores had 
been used. The extreme high and low aptitude groups used in 
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Table 8.7 

Correlations Among Scholastic Aptitude Test (SAT) 
and CAI Performance Measures 
(n=20)* 



- 


SAT 

U 


SAT 

M 


Posttest 

2 


Delayed 

Posttest 

2 


Errors 


Time 


Remedial 

Questions 


Verbal SAT 




.50 


.45 


.24 


-.41 


-.id 


-.18 


Math. SAT 






.47 


o51 


-.37 


-.07 


-.18 


Post test 1 








.93 


-.93 


-.49 


^.79 


Delayed Posttest 2 
Errors made in 










-.87 


-.50 

..55 


-.77 
.81 > 


program 












Time to complete 
course 






- 








.55 






the present preliminary analysis were selected as part of a 
larger experim'snt designed to investigate interactions between 
student abilivty and course sequencing variables. Although the 
present correlations may be spuriously high, they provide impor 
tant preliminary information concerning the nature of the rela- 
tionships between the variables. 

As can be seen in Table 8.7, correlations between the, SAT 
scores and the two achievement posttest scores ranged from .24 
to .51. The correlations of the verbal and mathematical SAT 
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scores with the number of errors made In the program were -\41 
and -.37 respectively. These correlations fall within the range 
of magnitude of correlations usually obtained between measures 
of scholastic aptitude and school achievement. It Is of Interest 
to note that one of the objectives of computer-assisted Instruc- 
tion Is to minimize the correlation between student aptitude 
and the outcomes of Instruction by adapting the Instruction to 
the abilities of the learner. Thus, If all students begin to 
approximate maximum achievement as measured by a criterion test, 
the correlation between aptitude and achievement would neces- 
sarily be decreased. Whether a truly adaptive Instructional 
program can br ig all college students to approximately the same 
level of achievement still remains to be demonstrated. 

Another father revealing set of correlations were those 
of the achievement criterion tests with errors and the number 
of remedial questions encountered by the student. The correla- 
tions of errors with posttests 1 and 2 were -.93 and -.87 respec- 
tively, while the correlations between posttests 1 and 2 ai«d 
errors is surprisingly high In view of the fact that the modern 
mathematics program Included approximately fifty per cent remedial 
branches designed to clear up student errors. If the remedial 
sections of the course had been serving their proper function, 
student errors made In the program would have been corrected 
by the remedial branch and the student should not have responded 
with the same errors on the posttest measure of achievement. If 




the remedial sections had in fact been correcting student errors, 
one would have expected a somewhat lower correlation between 
errors made in the program and errors made on the achievement 
posttest; The correlation of -.93 suggests that the student 
who was confused during the actual instruction remained confused 
on the achievement posttest. The above interpretation is based 
on correlational data and small samples and is therefore highly 
tentative; however, the results do call attention to the problems 
of evaluating the effectiveness of remedial branching programs 
for student learning. In the future we plan to make more specific 
comparisons between course programs with and without remedial 



instruction and comparisons of the effects of different types 
of remedial instruction. 

Table 8.8 shows the correlations between the ratings of 
attitude towards CAI and the SAT and CAI performance measures. 

As was seen in the earlier analysis, in general, the higher the 
SAT and achievement in the course the more positive the reac- 

• 

tion to CAI. The fewer errors and number of remedial questions 
encountered, and the shorter the time taken to complete the pro- 
gram, the more positive the attitude toward CAI* Although it 
is difficult to Interpret these relationsh'ips, it was probable 
that the student reacted primarily te his own performance in 
CAI rather than to his liking of CAI as a method of instruction. 



Several partial correlations were computed between the SAT scores 
and the Good-Bad rating holding posttest performance constant. 
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When student performance is held constant, the correlations be- 
tween the SAT scores and the Bad-Good rating decrease and become 
nonsignificant. In the case of the verbal SAT, the correlation 
dropped from .38 to .17, while for mathematical SAt the corre- 
lation dropped from .51 to .34. 

Probletns In Interpretation of self-report data are not un- 
common In many different areas of research. The present judg- 
ment of the Investigators Is that the utility of the Reaction 
Inventory has probably been exhausted. Since self-reports are 
InGxordbly entwined with 3 host of coroploK off®cts> it is frO" 
quently impossible to determine precisely what the student's 
self-report Is measuring. As demonstrated In the present study, 
the self-report, rather than measuring the student’s attitude 
toward a method of Instruction as such, appears to be la^easurlng 
his reaction to his own performance. If this Is the case, the 
self-report is providing very little new information over that 
of the performance measures. The self-report measure was em- 
ployed In the present Investigation In 11e_u of the development 
of more adequate criteria. As such. It served Its purpose by 

suggesting hypotheses for further study. 

The results of Table 8.8 also show that the student’s rat- 
ings on the Shallow-Deep scale and on the Difficult-Easy scale 
appear to reflect his perception of the difficulty of the course. 
Both scales appear to correlate with aptitude and performance 
In the expected directions. 
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Several findings obtained with the second sample of students 
bear on some earlier results obtained with the Initial group 
of 47 students. The reader will recall that a fairly large percen- 
tage of students reported being slightly teeise during the first 
hour of Instruction In the first sample. In analyzing the data 
for the second sample » essentially zero correlations were ob- 
tained between performance In CAI and the Tense-Relaxed rating. 

So far as this small sample of students Is concerned. It appears 
that whatever the student Is reflecting on this scale does not 
relate to his performance In the course. This finding Illus- 
trates another common difficulty with self-report data: what 

the student says he does and what he does are frequently two 
different things. 

The correlations of the CAI performance measures with the 
Slow-Fast rating simply reflects the student's perception of 
his rate of performance In the course. Thus, the students a- 
chlevlng higher scores on the posttests, making fewer errors 
In the course and taking less time to finish the material, tend 
to rate the course as fast compared to students scoring lower 
on the posttests and making more errors. 

One finding of considerable Importance relates to results 
obtained In the Initial sample of students. Thv?. number of 
correct answers entered In wrong form was found to correlate 
-.80 with performance on the achievement posttest In the second 
sample. It was tentatively concluded In the earlier study that 



J63 



Table 8.8 

* • " - , f * 

Correlations Amonc Scholastic Aptitude (SAT), 
CAI Performance Measures, and Attitudes 
Toi^ard CAI (n«20)* 




Ratings 



Course 

“Fast" 



Verbal SAT 


-.18 


Math. SAT 


.06 


Posttest 1 


*44 


Delayed 
Posttest 2 


.58 


Errors 


-.47 


Time 


-.51 


Remedial 

Questions 


-.53 



Good 


Fair 


Deep 


.38 


.46 


“ . 39 


.51 


.09 


- j 68 


.55 


.00 


‘*47 


.49 


-.16 


-.47 


-.46 


-.06 


.34 


-.42 


-.13 


.36 


cn 

CM 

• 

1 


.17 


.37 



Valuable Easy, 



17 


.37 


31 


.26 


32 


.45 


34 


.44 


20 


-.39 


11 


-.49 


22 


-.30 




.44 

46 




“bugs" encountered by the student In the course or correct 
answers entered In wrong form tended to seriously Interfere with 
studont learning. The results for the second sample tend to 
support this conclusion. The occurrence of wrong form errors 
tends to encourage content errors (e^g., the two are correlated 
.79) which In turn tends to produce poor poittest performance 
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(e•g.^ -.30). These data simply further emphasize the Impor- 
tance of partial-answer processing of student responses so that 
an answer which Is correct In its essential Elements Is accepted 
as correct by the computer. 

Final ly» although the numbers In each group are small, it 
Is of Interest to compare the distributions of posttest perform- 
an.ce for the two high and low aptitude groups.. These distri- 
butions are shown In Table 8.9. Perhaps the most striking ob- 
servation of student performance In CAI Is the tremendous varia- 
bility In performance and the large overlap of the distributions 
of high and low aptitude S^s. Clearly the majority of S^s in both 
groups demonstrated considerable learning on the achievement 
posttest. Only three S^s (one student In the high group) appeared 

' ' *v 

to exhibit little or no learning on the posttest. Nevertheless, 
the fact that even three students of college-level ability seem 
to exhibit no learning after Instruction designed to adapt to 
Individual differences by providing the necessary remedial work 
Is the challenge still facing researchers Interested In the prob- 
lems of student learning In adaptive Instructional systems. 
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Table 8.9 

Distributions of Posttest Achievement Scores 
of High and Low Aptitude Groups 



Scores 


Low SAT 


High SAT 


21-22 




5 


19-20 


1 


2 


18-19 


1 




16-17 


2 


1 


14-15 


1 




12-13 




2 


10-11 




1 


8-9 


1 




6-7 






4-5 


- 




2-3 


1 


1 


0-1 


1 






8 


12 
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CHAPTER IX 



DEHONSTRATIOH AND DISSEHINATION 

One major purpose of the present project was to provide 
demonstrations to educators of a functioning prototype of a CAI 
system and to disseminate information pertaining to our experi- 
ence With CA!. This objective was based on the assumption that 
Implementation of educational Innovations Is most likely to 
occur as a result of live “hands on“ demonstrations given to 
educators. To make some Inroads In the problem of Information 
dlssemi/iationf the project undertook a large number of live 
demonstrations of CAI f produced a video-tape demonstration and 
a 16mm sound, color film on CAI, prepared several short demon- 
stration courses Illustrating different aspects of CAI, presented 
and published several research reports of preliminary results 
with CAI > and conducted a conference on the application of CAI 
to the In-service preparation of teachers. Each of these activi- 
ties Is summarized briefly. 

Our guestbook contains 981 names of visitors to the CAI 
Laboratory at Penn State, but It Is estimated that over 500 
Individuals have i^een a live demonstration of CAI at the Labo- 
ratory. These Individuals possessed many different backgrounds 
of experiences such as educator, psychologist. State Director 
of Vocational Education, writer. Director of Teacher Education, 
Professor of Engineering, Professor of Mathematics, physiologist. 
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sociologist, counselor, military officer, and newspaperman. 
Professional educators from Denmark, Hong Kong, France, Sweden, 
Australia, Bulgaria, China, Germany, Sudan, and many other 
western nations have been among our most interested visitors. 

Many of the demonstrations have promoted much stimulating dis- 
cussion concerning the potentials of CAI in a variety of educa- 
tional situations. 

In addition to the live demonstrations, the writers in 
cooperation with the Instructional Television Services of The 
Pennsylvania State University, produced a video-tape demonstra- 
tion of a student working at the CAI teaching tfi'f'minal. This 
video-tape is shown regularly to students in the introductory 
educational psychology courses which prepare several hundred 
potential teachers per term. The taped demonstration was also 
shown to a conference in continuing education and to a group at 
the United States Office of Education in Washington. 

During the summer of 1965 the instructor of the intro- 
ductory educational psychology course invited Professor Hall 
to participate in the preparation of a 75-minute video taped 
discussion on programmed instruction and particularly bn CAI. 

The program developed the historic and scientific progress of 
programmed instruction and utilization procedures for teachers 
with particular emphasis on C^I which included demonstration of 
a CAI course incorporating all of the available, functions, taped 
recorded messages, and projected images from the slide projector. 
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Several short demonstration courses have been prepared to 
Illustrate various capabilities of CAI to the visitor. The 
courses may be briefly described as follows; 

mdl and md2 - a short segment of material covering several 

elementary concepts of educational measure- 
ment. The demonstration illustrates various 
capabilities of the slide projector and tape 
recorder units. The course also includes a 
five question quiz related to the concepts 
taught. The student’s score is typed for 
him, and he is told specifically Which ques- 
tions he missed on the quiz. The program 
then branches to a remedial section, and the 
student is given specific information on why 
the specific answer he chose for each missed 
question was wrong and in addition the correct 
answer. 

spa-430x - The first chapter adapted from the course - 

speech pathology and audiology, which Is 
designed to teach students the anatomic®! 
parts of the outer, middle, and inner. ear. 

This chapter provides computer branching 
decisions based upon the student’s prior 
knowledge about certain segments, the stu- 
dent’s accumulated responses to previous 
material; and the student’s performance on 
quizzes throughout the course. 

The following papers have been presented reporting prelimi- 
nary findings of the present CAI project; 

Wodtke, Kenneth H. and Mitzel, H.E. Some preliminary 
results m the reactions of students to computer- 
assisted instruction. A paper presented at the 
IBM Conference on Computer Assisted Instruction, 

T. J. Watson Research Center, Yorktown Heights, 

N.Y., February 2, 1965. 

Wodtke , Kenneth K., Mitzel, H. E., and Brown, B. R. Some 
preliminary results on the reactions of students to 
computer-assisted instruction. A. paper presented at 
the Pennsylvania Educational Rc 3 c arch Association, 
University of Pittsburgh, April, 1965. 




Modtke, K. H., Mitzel, H. E., and Brown, B, Ra Some pre- 
liminary results on the reactions of students to 
computer-assisted instruction. Proceedings of the 
73rd Annual Convention of the Ame rfcarrTsyc hCTo ol ca 1 ‘ 
Associatfi^ , 1965. PiTper’ was reacTat the 1965 ApA , 
meet'tng. 

Wodtke, Kenneth H* On the assessment of retention effects 
in educational experiments, November 1965. 
{RevisedrFfebraary"1966) 

Presented at AERA on February 15, 1966. 

Nodtke, K. H. Computer Assisted Instruction; A simulated 
tutbrial approach. Paper presented to the National 
Society of College Teachers in Education, Chicago, 
Illinois, February, 1966. 

Wodtke;, K, H. A symposium on the topic computer assistance 
for research on Instruction at the American Educational 
Research Association convention, Chicago, IllinoiSt 
February, 1966. 

Wodtke, (C. Ho and Gilman, Do A, Some comments on the 
efficiency of the typewriter interface in computer- 
assisted instruction at the high school and college 
leVelSo A paper presented at the Annual Convention 
' of the Association of Educational Data Systems, 
Rhiiadetphia, Pennsylvania, May 1966 0 

MitzeU Harold E. Five major barriers to the development 
of computer-assisted Instruction. August 1966. 

Remarks prepared for American Management Association 
Meeting, Americana Hotel, New York City, August 12, 

1966. ■ 

Wodtke, Kenneth H.. Educational requirements for a student- 
subject matter interface. 

Paper presented at Spring Joint Computer Conference, 
Atlantic City, New Jersey9 April 19, 1967. 

Hall, Ksiih A., Adams, Marilyn, and Tardibudno, J. Cueing 
and feedback in coniputer-asslsted instruction. Paper 
presented at NEA National Convention, Department of 
A-V Instruction, Atlantic City, New Jersey, April. 5, 

■’ .1967.' ■ ' , ■' 

Wodtke, K. H. Some perspectives on compuUr-assisted instruc 
ti oh. Paper presented to the Pennsylvania Educational 
Research Association, Bucknell University, May 19, 1967. 
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Mitzel , Harold E, Computer assisted instruction - origins, 
definitions, and growing pains. Paper presented to 
the American Society for Engineering Education Annual 
Meeting, Michigan State University, East Lansing, 
Michigan, June 21, 1967* 

A conference was held at Penn State on April 6, 1965, to 
discuss application of compute: -assisted Instruction to In- 
service preparation of Pennsylvania teachers of modern mathe- 
matics. A current problem In the area of mathematics Instruc- 
tion is that of updating the preparation of teachers in the "new 
mathematics*" Existing In-service preparation methods are slow 
and frequently only reach a small percentage of teachers. During 
the above conference, member? of the Penn State CAI project dis- 
cussed with educators from the Pennsylvania Department of Public 
Instruction the possibilities of providing such Instruction by 
means of remote CAI teaching stations placed at strategic loca- 
tions throughout the state. Although there are a number of 
problems still to be worked out concerning the practical applica- 
tion of CAI, it was the general impression of the conference 

that such an application was feasible. 

In Oanuar>' 1967 a one-day conference for superintendents 
and principals was held in Hilliamsport, Pennsylvania, at which 
time the research conducted by the CAI staff and the use and 
potential of CAI were discussed under the direction of Professor 
Riedesel and Kiss Suydaro of the CAI staff. This conference 
summarized a CAI project which was conducted during the fall, 
1966, by the Williamsport Area School District sponsored by the 



U. S. Office of Education under Title III of the Elementary and 
Secondary Education Act. The IBM T. Watson Research Center 
at Yorktown Heights, New York, provided full-time computer 
service for the forty elementary school teachers of mathematics 
who participated in the in-service "hands-on*' terminal presenta- 
tion of the modern mathematics course. 

A second conference on computer-assisted instruction, 
sponsored by the Office of Naval Research, was held at the 
Conference Center of the Penn State Campus. CAI staff members, 
including Professors Mitzel, Hall and Wodtke, made presentations 
to an audience of 67 professionals interested and involved with 
programed learning and specifically computer-assisted instruc- 
tion. All members attending this invitational conference were 
provided time for a live hands-on demonstration at the CAI 
terminals and a visit to the Computation Center at Penn State. 

A number of off-campus live demonstrations have been ar- 
ranged and conducted by the Penn State staff. The first off- 
campus demonstre n occurred on October 30 through November 2, 
1965, at the American Speech and Hearing Association (ASHA) 
Convention in the Sherman Hotel in Chicago. A display area, 

9 feet by 20 feet, was constructed and contained display panels 
of information about computar-assisted instruction. In a<ldition 
to this exhibit, a brochure was printed and distributed to inter- 
ested visitors in the exhibition hall. Professors Mitzel (Project 
Director) and Siegenthaler (course author for speech pathology 
and audiology) and Mr. Jeffrey Katzer (graduate assistant to 
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Dr, Siegenthaler) represented Penn State and conducted the 
demonstrations at the exhibit. A closed circuit television sys-, 
tern with a video-tape recorder was used as an integral part of 
the exhibit. During those times when computer* service was not 
available, a video-tape recording of a CAI demonstration espe-, 
cially prepared for this convention was shown on a closed cir- 
cuit system. 

From November 30 through December E, Penn State again ex- 
hibited the audiology course taught by CAI at the Fall Joint 
Computer Conference in Las Vegas, Nevada. Professor Hall i of 
the Penn State Staff, conducted this demonstration which was 
house vin a ^peci^A exhibit area entitled "Computer Dimensions 
in Learning. Although the large display material was not used 
for this conference, the closed circuit video-tape system and , 
the on-line audiology course were used. During the course of 
the conference, six organized tours of approximately thirty 
people each were conducted through this special exhibit areai 
At that time, an opportunity was provided for each exhibitor to 
explain- and describe to the group their efforts in utilizing 

computers for Instructional purposes. 

The American Educational Research Association (AERA) held 
their annual convention at tbe Pick Congress Motel in Chicago, 
Illinois, from February 17 through February 19, 1966. The Penn 
State CAI Laboratory was invited to provide an educational dis-, 
play for the convention. This was the first exhibit of its typ® 
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that has been shown at an AERA convention. Again the large wall 
panels and the complete exhibit were trucked to Chicago for this 
exhibition; the closed circuit video-tape recording equipment 
was used on a standby basis only. The Penn State Computation 
Center and the IBM T. 0. Matson Research Center at.Yorktowh 
Heights, New York, were able to provide us with full-time com*^ 
puter service for this convention. This was the first large- 
scale utilization of the Penn State Computation Center for CAI 
purposes and bur experience was most gratifying. In addition 
to our cibsed circuit video-tape recording equipment , we had a 
small camera mounted above the CAI terminal so that the material 
being typed for the student cOuld be seen by .a large group of 
observers on a television monitor which was part of the exhibit. 
The staff representing the CAI Laboratory for this exhibit were 
Professors Bjorkquist, Hall, Johnson, Mitzel, Slegenthaler, and 
Modtke; "Hr I Jeffrey Katzer also participated* 

The Amerl ban Personnel and Guidance Association held Its . 
anndal Convention at the Municipal Auditorium In Dallas, Texes, 
from Marbh 19 ’through March 23, 1967. It. was estimated that , 
approximately two thousand members viewed the CAI exhibit which 
consisted of bn-llne course segment presentation. During the 
times when computer service was not available, a continuous loop 
slide- and tape presentation was In operation. The staff repre- 
senting the CAI Laboratory for this exhibit were Professors 
Impdtlltterl , ihd Campbell; Mr. Scott Kostenbauder also partici- 
pated In the presentation of this demonstration. 
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From April 6 through April 8, 1967, Pann State again ex- 
hibited the audiology course taught by CAI at the Pennsylvar^la 
Speech and Hearing Association annual meeting In Pittsburgh, 
Pennsylvania. The complete display set-up was used for this 
presentation, which was conducted by Professors Mltzel and 
Slegenthaler , with Messrs. Kenneth Getschew and James Stauffer 
assisting. ^ 

Other dissemination activities have also been undertaken 
by the staff members of the CAI Laboratory. Professor Cramer, 
author of the CAI Introductory management accounting course, 
published an article in the January 1966 Issue of Management 
Accounting , which Is Included as an appendix to this report. 

He has also lectured to honor students In business administration 
on the University Park campus and to the Convention of Accounting 
Professors of the State of Pennsylvania. Professor Cramer prer 
sented a lecture to graduate students of Atlanta University 
entitled "The Computer as a Medium for Teaching of Accounting." 

Professor Riedesel, authov of the modern mathematics course, 
made presentations about CAI at the convention of the National 
Council of Teachers of Mathematics, at the Americana Hotel, New 
York City, on April 14. His presentation Included the use of 
an overhead projector and a slide projector for displaying E x 2- 
Inch slides pertinent to CAI. Other similar CAI presentations 
made by Professor Riedesel were In Philadelphia to the Associa- 
tion of Educational Data Systems; In April 1967 at the National 
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ElefsentAry Principals Conference in Boston t Massachusetts t at 
which time his talk centered around the information gained from 
experience with CAI and directions in elementary school mathe- 
matics; and on May 6, 1967, to the New Jersey Section of the 
Mathematical Association of America in New Jersey, on CAI in 
modern mathematics. 

Professor Mitzel has made several presentations regarding 
CAI. He participated in a regional research conference held at 
University Park campus on November 3, 4, and 5, 1965. This 
conference was attended by researchers in the field of Agricul- 
tural Education from 12 states and from the U. S. Office of 
Education. Professor Mitzel showed the video-tape recording of 
a GAI demonstration for this group of people. This same vidxio- 
tape recording was also used by Professor Mitzel for the Council 
of Academic Deans at Penn State University on February 28. A 
set of 2 X 2-inch colored slides have been prepared illustrating 
the CAI effort at Penn State. These have been r:sed extensively 
by Professor Mitzel in various presentations he has made. One 
presentation was to a group of about 20 graduate students at 
the Institute for Educational Communications at Syracuse Uni- 
versity on April 6, 1966. Another presentation was made at Kings 
College at Wilkes-Barre to the Higher Educational Regional Group 
on May 10. On June 21, 1967, Professor Mitzel presented a paper 
to the American Society for Engineering Education at their annual 
meeting at Michigan State University, in East Lansing, Michigan. 
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Professor Uodtke has participated in several panel discus- 
sions and presentations regarding CAI, In September. 1965 he 
presented a paper on CAI at the American Psychological Associa- 
tion meetings in Chicago$ Illinois.. He also participated in a 
panel discussion at the American Educational Research Associa- 
tion meetings in Chicago and during the same period participated 
in a panel discussion which was organized by the Pehn State staff 
at meetings of the National Society of Colleges of teacher 
Education. A paper was presented In early May 1966 at the 
American Educational Data Systems convention in Philadelphia, 
Pennsylvania; another at the Pennsylvania Educational Research, 
Association at Bucknell University on May 19, 1967; and one on 
the educational requirements for a student-subject matter inter- 
face, a paper which is included as an appendix to this report, 
at the Spring Joint Computer. Conference held in Atlantic City, 

New Jersey, o« April 19, 1967. 

The final dissemination aspect of this project is a 24- 

I 

minute 16mm sound, color film on computer-assisted instruction 
produced under the direction of Professor Donald W. Johnson. 

The title “Sign on/Sign off" is suggestive of one unique require- 
ment of this type of Instruction. 

The main purpose of the film is to generate an interest In 
computer-assisted instruction and a desire on the part, of the 
viewers to further explore the potentials of this new medium. 

The iotent, therefore, is to motivate the audience to further 
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explore end study. By so do1n9» they should become better In- 
formed potential users of computers in education. 

mth the above objective In mind, the film contains short 
sequences of computers In operatton, students at the terminal, 
teaching-learning situations, remarks of experts, close-ups of 
displays and type-outs, and other short segments designed to be 
visually Interesting. Scenes are numerous and short to the. 
Interest of the viewers. 

The film Is Intended primarily for educators who have had 
no Introduction to computer-assisted Instruction. The audience 
could be In-scrvice teachers or administrators, college students 
planning to enter the field of education, or Interested, Informed 
people outside the field of education. Where possible, the 
language Is non-technical . 

After a brief Introduction, Sign on/S1gn off seeks to estab- 
lish the need for technology In education by showing school 
scenes of the early 1900*s and contrasting these with current 
needs; social and technological developments are depicted. The 
Socratic s'^ethod with an emphasis on Individual differences Is , 
related ^;hrough scenes of a master teacher and five students In 
a learning situation. The next scene shows learners at the 
terminal Interacting with the same material as In the prior 
scene; parallels are drawn between teaching as accor..pl1$hed by 
a master teacher and that of a computer. Emphasis Is again on 
Individualized instruction to meet unique needs of the learners. 





The audience is shown how CAI works through an animated sequence 
utilizing abstract forms to relate certain mechanical and elec- 
tronic functions. The final scenes are of educators connected 
with the Penn State project comncnting, in their own words, on 
certain aspects of computer-assisted instruction of interest to 
the audience. 

The 16mm sound film is in color and approximately 24 minutes 
in length. It was produced by The Pennsylvania State University 
Motion Picture Production Studio, and when approved by the staff 
of the U. S. Office of Education, the film will be available 
through the usual distribution channels. 
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Appendix A.1 

Summary of Coursewriter Operation Codes 



Primary 

» / * jf , , ■ 

rd - Computer types text and waits for the student to signal 
completion. Commonly used to display a reading assign- 
ment to a student. 

rdn - S^meas rd, but does not update restart address. 

qu - Computer types text and waits for student to type a response. 
Commonly used to display questions or problems to a stu- 
dent. 0 

gun - Same as qu, but does not update restart address. 



ca - Correct answer to be stored in memory for comparison with 
.student's answer, 

^ ^ ^ ' :r ■ ■ 

cb - Similar to ca - used to Identify a set of alternate correct 
answers - the subsequent action Is to be the same regard- 
less of which answer In the set Is matched by the, student's 
response. , 

wa - Wrong, answer to be stored for comparison with student's 
answer. 



wb - Similar to wa - used to Identify a set of alternate wrong., 
answers - the subsequent action Is to be the saine regard- 
less of which answer In the set Is matched by the student's 
response. 




ab 



un 



- Anticipated answer - similar to ca and wa, but not followeid 
, by implicit .branch. 



Similar to aa * used to Identify a set of alternate anticl 
pated answers - the subsequent action Is to be the same . 
regardless of which answer is matched by the student's 



response. , i 

Text to be typed If the student/ s answer is not one Of the 
specified correct, or wnmg answers. i 






~ 1*^* computer to execute the instruetion(s) 

immediately following the nx. The purpose of the nx is 

a minor operation code (e.g., ty or fn) to a 
major operation code. '•x «r to; co a 

— ■ !!"! - computer ignores anything typed by the stu- 

dent after the specified time has lapsed. 






nor 






br 



Branch - alters the segtlence of execution 

is always taken 

Conditional; branch is taken only if a particular 

condition is satisfied. - 



it M 



dd 



Id 



dv 



’ tn*"* ? "““‘'e'’ O'" the contents of a counter 

Load - clears a counter and adds a number (or the contents 

" blr^in rS^Jiter?^ ® counter by a constant or by the n urn- 



nm - 

lEl- 
ftO - 

■— I m I nil 

tpl - 
tpQ - 

wmSmcum* 



n!!mbe?in*'f coHnU?! ® ® «"stant or by the 

display a slide. 

Seek and position a slide, but dioes hot display It. 

Play a tape recorded message. 

Seek and position tape recorded messagd but does not play 



iS£ 

fn 



- Recoril d tape v . 

- Computer executes the specified function. Functions are 

a mach?^ " 

languaoe subprogram) so that the conputer can do prdces- 
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fa 

fn 

la 

fn 

, * i 

fn 

fn 

fa 

fn 

fn 

fa 

fa 

fn 






^ slide//n - The disalay slide function is used to present 
a slide; n represents the number of the slide to be 
displayed, c 

- slide//nx - The seek and position slide function will seek 
and position slide n, but will not show the slide until a 

: display slide function occurs in the program. 

- tape//n - The play tape function will play tape recording 
' namber n, , 

- tape//nx - The seek and position tape function causes tape 
: recording number n toTe posTtToned. The recording will 

not play until a tape play function occurs in the program. 

- dc// - The display c-counter function is used to display 
the contents of a c-counter to the student. 

'“r ' ■ *. \ ’ J \ ‘ 

- dx// - The display x»counter function is used to display 
the contents of an x-counter to a student. 

- wait// - The wait function allows the author to delay the 
program beforCf execution. ; j 

- kw// r The key word function allows the author to specify 
’ one or more key words which must be matched In the; stu- 
dent *s answer, 

- kwo// - The key words ordered function is similar to the 
key word function. However, the key word ordered func- 
tion also requires that the matched key words in the 
student's response are entered in a specified order. 

- kwi// - The key words initial function searches for the 
words that have been entered in the ca or wa. If the 
function finds a word in the student's response not in 
the ca or wa, the function is terminated. 

- kw//io - The words ordered and ini tial function 
searches for key words 'in the student *s response, Thib 
function insists that the student's response be in a 
certain order and also checks to insure that there are 
no unmatched key words in the student's response. 

- 11m - The lim its function allows the author to specify 
mathematical TTmits within which the student's numerical 
response will be acceptable. 



188 



fn - paO// - The partial answer zero function allows an author 
to disregard extraneous discrepancies between a student*?^ 
response and the text of a ca, wa, or aa; This function 
is used to process answers which ar^ misspelled or 
partially correct, 

fn - irand// - The pseudo random integer function allows authors 
to specify that a pseudo random integer be placed in a 
c-counter. 

fn - ic// - The initial characters function allows authors to 
specify that only a certain designated number of initial 
characters in the student’s response are to be compared 
with a subsequent ca or wa. The function also allows the 
author to specify that characters in certain positions 
of the student's response are Irrelevant and are to be 
considered matched. 

fn - ed// - The edit function allows an author to edit the stu- 
: dent's’ response by replacing or deleting characters^ 

fn - sb// and rb// - The save and branch function (sb) allows 
the author to insert in one place withjn a course a 
certain sequence of material (subroutine) which can be 
branched to repeatedly thus limiting the necessity for 
programming the same material at repeated plates within 
the course. The return branch (rb) function returns the 
student to a point in the course as directed by an address 
indicated in the text of the sb function. 
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.. . : APPENDIX B.l - rv 

SAMPLE OF STUDENT'S TYPEOUT^ 

A Sample of Dialogue between. a Student 
and the Computer for a Section 
of Instruction on the Anatomy of the Outer Ear 

i 



Computer jgtWdcnt Reap one e$ 

- (tOBj 

make a request 

a 1948 y apa430 

03/31/66 12:18 

1. Dicken spa430 ’ , , ! 

1-1. Following the normal pathway . 

of sound, type the names of 
the three main divisions of 
the ear In their correct order o 

outev* middle, inner 

^ < r - - r 



1-2. What Is another name for the 
external ear? 



external auditory meatua 



Is one part of the external 
ear. The desired term Includes 
all of the external ear. Try 
again. 



outer 



Correct, Another name for 
the external ear Is the 
outer ear. Be careful of 
your spelling and typing. 




^All student responses appear on the right. 





\ 



1S2 



Computer student Resvoneee 

1-3, What Is the name for that 
part of the external ear 
most visible and on the 
outside of the head? J 

ear 



What 1e the term used In 
Newby"^ sr Figure 2-2 on 
page 16, for the externally 
most visible pari? 

pinna 

^ ^ " -N ^ 

Correct. The terms “pinna" 
and auricle are synonymous. 




Uhat small structure of the 
ear divides the external 
ear from the middle ear 
(you need a SPECULUM to see 
It)? 



is correct. However, a 
more technical name that we 
shall be using is: tympanic 

membrane type: tympanic, 

membrane and press: EOB 




eardrum membrane 




tympanic membrane 
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... . Appendix C.l 

^ STUDENT ATTITUDE TOWARD COMPUTER ASSISTED INSTRUCTION 

1 i . * 

This Is not a test of fnfonnation; therefore, there is' no one ‘‘right" answer to a question. 
Wfc are interestfid in yoyr opinion on each of the statements below. Your opinions will be 
strictly confidential. Do not hesitate to put down exactly how you fael about each item. 

We are seeking infonnation, not compliments; please be frank. 



NAME 



DATE 



NAME OF COURSE ' ' — - 

CIRCLE THE RESPONSE THAT MOST NEARLY REPRESENTS YOUR REACTION TO EACH OF THE STATEMENTS 
BELOW: . 

1. WhVVe taking Computer Assisted Instruction I felt challenged to do my best work, 



Strongly 
Di sagree 



Di sagree 



Uncertain 



Agree 



Strongly 

Agree 



2 The materi al presented to me by Computer Assisted Instruction caused me to feel that 

no one- really cared whether I iearnei or not. 



Strongl)^ 

Disagree 



Disagree 



Uncertain 



Agree 



Strongly 
. Agree 



3. The method by which. I was 
monotonous . 



told whether I had given a right or wrong answer became 



\ ' T 



Strongly 

Disagree 



Uncertai n 



Agree 



Disagree 

4. I was concerned that I might not be understanding the material 



Strongly 

Agree 



Strongly 

Disagree 



Strongly 
‘ Agree 



Disagree .Uncertain Agree 

5, I was not concerned wheri I missed a question because no one was watching me anyWay. 



V- Strongly 
-.>Di sagree 



Disagree 



Uncertain 



Agree 



Strongly 

Agree 



o . 
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Is. While taking, Computer Assisted Instruction I felt isolated and alone. 



All the 
time 



Most of 
the time 



Some of 
the time 



Only„ . 

occasionally 



Never 



7. While taking Computer Assisted Instruction I felt as if someone were engaged in 
’ 0 ' conversation with me. • 



All the 
time 



Most of 
the time 



Some of^ 
the time 



Only 

occasionally 



Never 



8. The. responses to my^ answers seemed appropriate. 



J ‘ . 



VAll the, 
tir ^ 



Most of 
the time 



Some of 
the time 



Only 

occasionally 



Never 



9., I felt uncertain as to my performance in the programmed course relative to the 
performance of others. 



All the 
time 



Most of 
the time 



Some of 
the time 



Only 

occasionally 



Never 

pO. ,1 found myself just trying to get through the material rather than trying to learn. 

Never 



All the 
time 



Mcst of 
the time 



Some of 
the time 



Only 

occasionally 



11. I knew whether my answer was correct or not before I was told. 



Quite often Often Occasionally 

112. I guessed at the answers to questions. 



Seldom 



Very Seldom 



Quite often 



Often 



Occasionally 



Seldom 



7cry Seldom 



[13. In a situation where I, am trying to learn something,. It is important to me to 
know where 1 stand relative to others. 



Strongly. 

Disagree 






Disagree 



Uncertain 



Agree 



Strongly 
? Agree 



lERiC 



I. 
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14. I was encouraged by the responses given to my answers of questions. 



- ; 5 . . • 

Strongly Disagree Uncertain Agree Strongly 

Disagree . . ■ Agree 

15. As a result of having studied some material by Computer Assisted Instruction, I 
am interested in trying to find out more about the subject matter. 

: : : • ‘ • 
Strongly Disagree Uncertain Agree Strongly 

Disagree ; . Agree- 

1C. In view of the time allowed for learning, I felt too much material was presented. 

All the Most of Some of Only Never 

time the time- the time 'occasionally 

17. I was more involved in running the machine than in understanding the material. 

■ : : I : ■ • 

All the Most of Some of Only Never 

time ' the time the time occasionally 



18, I felt I could work at my own pace with Computer Assisted Instruction. 



; • • 
strongly Disagree Uncertain Agree 

Disagree • ‘ 



Strongly . 
Agree 



19. Computer Assisted Instruction makes the learning too mechanical. 



20 . 



: 

Strongly Disagree 

Disagree 



Uncertain 



Agree Strongly 

Agree 



I felt as if I had a private tutor while on Computer Assisted Instruction. 



Strongly Disagree Uncertain Agree 

Disagree 

21. I was aware of efforts to suit the material specifically to me. 

' ... .■ .. ' '■ : . ... . ■ : 

Strongly Disagree Uncertain Agree 

Disagree 



Strongly 
.. Agree 



Strongly 

Agree 



I found it difficult to concentrate on the course material because of the hj^rdware.. 



All the 
time 



Most of 
the time 



Some of 
the time 



Only 

occasionally 



Never 



23 . 



24. 



The Ccimputer Assisted Instruction situation made me feel quite tense, 

. Disagree Uncertain Agree 

Questions were asked which I felt were not relevant to the material presented. 



Strongly 

Disagree 



Strongly 

Agree 



All the 
time 



f*ost of 
the time 



Some of 
the time 



Only 

occasionally 



Never 



25. Coifiiputer Assisted Instruction Is ein Inefficient use of the student's time. 



Strongly 

Disagree 



Strongly 

Agree 



26. 



Disagree Uncertain Agree 

I put In answers knowing they were wrong In order to get Information from the machine 



Quite often 



Often 



Occasional ly 



Seldom 



Very seldom 



27. 



Concerning the course material I topk by Computer Assisted Instruct1on^ my feeling 
toward the material before I came to Computer Assisted Instruction was: 



Very 

favorable 



Favorable 



Indifferent 



unfavorable 



Very 

unfavorable 



28. 



Concerning the course material I took by Co..iputer Assisted Instruction, my feeling 
toward the material after I had been on Computer Assisted Instruction Is: 



Very 

favorable 



Favorable 



Indifferent 



Unfavorable 



Very 

unfavorable 



29. I was given answers but still did not understand the questions. 



Quite often 



i M ‘ 



Often 



Occasionally 



Seldom 



Very seldom 




30, While on Computer Assisted Instruction I encountered mechanical malfunctions. 



31. 



Very often Often ^ 'Occasionally Seldom Very seldom 

Computer Assisted Iristruction made it possible for me to learn quickly. 






strongly 

disagree 



32. 



Disagree Uncertain Agree 

» 

I felt frustrated by the Computer Assisted Instruction situation. 



Strongly 

agree 



Strongly 

disagree 



Disagree 



Uncertai n 



Agree 



Strongly 

agree 



> 1 ‘ 



33. The responses to ny answers seemed to take into account the difficulty of the question. 



Strongly 

disaqree 



Disagree 



Uncertain 



Agree 



Strongly 

agree 



34. I could have learned more if I hadn't felt pushed. 



i ' *. 
. / 



Strongly 



•d W 

disagree 



Disagree 



Uncertai n 



Agree 



Strongly 

agree 



35. The Computed Assisted Instruction approach is inflexible. 



Strongly 

disagree 



Disagree 



Uncertain 



Agree 



Strongly 

agree 



36. Even otherwise Interesting material would be bor’ng when presented by Computer 
Assisted Instruction. 



Strongly 

disagree 



Disagree 



Uncertain 



Agree 



Strongly 

agree 



37. 



In view of the effort I put irto it, I was satisfied with what I leaned while taking 
Computer Assisted Instruction. 



Strongly 

disagree 



Disagree 



Uncertain 



Agree 



Strongly 

agree 



o 
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o' 



In view of the amount I learned^ I would sey C&iiputer Assisted L.^truction is 
superior to traditional ins tructliDn* . * 



Strongly 

disagree 



Disagree 



Urscertain 



Agree 



Strongly 

agree 






Whith a course such as I took by Computer Assisted Instruction* I would prefer 
Computer Assisted Instruction to traditional Instruction. 



1 



Strongly 

disagree 



Disagree 



Uncertain 



Agree 



Strongly 

agree 



I am not in favor of Computer Assisted Instruction because it Is just another step 
toward de-per^onali zed instruct! on. ' r ■ ’ 



Strongly 

disagree 



Disagree 



Uncertain 



Agree 



Strongly 

agree 



0 

0 



{IS SPACE IS PROVIDED FOR ANY COMMENTS YUU CARE TO MAKE ABOUT COMPUTER ASSISTED INSTRUCTION. 



' i :V’ V'' 



M i 






M . ' f 



|er|c 
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APPENDIX D 

Speech Pathology and Audiology CAI Course 

Page No . 



D. 1 


Sample of Speech Pathology and Audiology 
Self-Study Guide . 


. . 203 


D.2 


Anatomical Slide Description for SPA 430 


. . 207 


D.3 


Sample of Speech Pathology and Audiology 
CAI Program 


. . 213 


0.4 


Flow Chart and Interpretive Noics for 
the First Part of SPA 430 


. . 223 


0.5 


Sample Static Display for SPA 430 . . . . 


. . 225 


0.6 


Sample Student Handout for SPA 430 . . . 


. . 22? 
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Appendix D.l 

Sample of Speech Pathology and Audiology 

Self-Study Guide 

SPA 430 

This Is the Penn State Course Speech Pathology and 
Audiology 430: Introduction to Audiology. SPA 430 Is taught 

ty Individual work and by classroom Instruction. There Is one 
classroom period per week. It Is the student's responsibility 
to schedule the required Individual work at the study center 
after each classroom period and before the next class meeting. 

The textbook for this course Is Audiology (2nd Edition) by 
Hayes A. Newby. Because the study material often refers to the 
book. It should be available at all sessions, as well as during 
the class periods. 
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Now proceed to the following s'tddy ina te rials. They will be 
given to you In this folder, a week;*s ..worif at one t1»id. 

The plan Is to present a question, and then to give Its 
answer or to give you a series of directions. There av’e a num- 
ber of audio-visual aids, such as models and slides to help you. 
.41 so, you are to have a number of handout sheets to be completed 
as Instructed, lise the study materials to your best advantage, 
but in general follow the sequence as presented. 

the materials are in “chdi)ters,'‘ but these are not the same 
as chapters In your textbook, tach question has an Identifica- 
tion number indicating chapter and question nuimber. Occasionally 
a number will be skipped because It is not needed, (even though 
the question was given for convenience for students working at 
the CAt terminal). 

You should ask the proctor for the necessary models, hand- 
out materials, slides, and slide projector facility. The slides 

are Identified by Aud . numbers . 

When you are finished with a study session return all models 
and slides to the proctor. Keep your folder and handouts for 
your own use, or leave them with the proctor as you wish. 

You are to proceed with these study materials at your own 
pace and schedule. 

However, you must complete all of a week's work during that 
week. Do not fall behind, because you must be ready for the 
next week's work. 



. 
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Materials for;Ch^>^t' 



Handouts (in your folder): 

Right Human Pinna 

Aspects of Temporal Bone 

Schema Right Ear: Transverse Section 












Slides (by nurber; obtain from proctor) 
4j 8-9, 19-20 



( 1 ) ‘ 









Other (obtain from proctor): 
Pinna 
Skull 



i 



i , ■; 
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^ SPA 430 
Chapter I 



If you have not done so already, read pages 16-18 in Newby. 
When this reading is completed, proceed. 

Here are the main points you sh.dfil^^kndw: 



1 . 

2 . 

3. 

4. 



Three main djylslons pf . the^e^J^ r r r ‘ - 

Names and functions of the parts of the outer ear 
Names of the parts of the pinna (per your Handout) 
Correct spelling of the anatomical terms 



Now begin the question-answer sequence. 



1-1. Following the normal pathway of sound, what are the names 
of the three main divisions of the ear In their correct order. 

I l\ \ : 

outer ear, middle ear. Inner ear 



1-2. What Is another name for the outer ear? 

External ear Is correct. The first division of the ear Is 
the outer or external ear . 

1-3. What Is the name for the part of the external ear most 
visible and on the outside of the head? 

aurl cle or pinna . The terms pi nna and aurl cle_ are 
synonymous 



o 
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Appendix D.2 

ANATOmCAL SLIDE OESCRIPHON FOR SPA430 



Meek 

No. 


Chapter 

No. 


Slide 

No. 


' ' ' ' ♦ 'J 

Title of Slide and Brief Description 




... } 


4 


*THE RIGHT HUMAN PINNA (Similar to stu- 
dent's. Handout with no parts labeled) 


1 


. } -■ 


8 


THE RIGHT HUMAN PINNA (This has seven 
of the parts labeled) 


T 


T 


9 


•THE RIGHT HUMAN PINNA (Similar to stu- 
dent's Handout with all parts, labeled) 


1 


1 


19 


♦ASPECTS OF TEMPORAL BONE (Similar to 


;? 1 •: 






student !s Handout with all parts ' 
labeled) 


% r 

^ t 

1 


r, , 

1 


I ^ 

20 


♦schema high! EAR--TRANSYERSE SECTION 
(Similar to student's Handout with 




* 




alT parts ; 1abe1ed)| , 


1 


2 


28 


RIGHT TYMPANIC MEMBRANE (This slide lis. 


-t 




. 


used to quiz students on the CA! ; 
terminal to see whether or not they 
know four parts of; the tympanic 




>j « ' 




membrane f) - - ; 


1 


2 


29 


RIGHT TYMPANIC MEMBRANE (Part of the 
student's Handout Is filled In and 








labeled.) 


1 


''.'■2,..' : 


30 


'♦RIGHT TYMPANIC MEMBRANE (Similar td 
student's Handout with all parts 
filled in.) 


1 ! 


,y \ \ f 2"' * 


! 1 

31 


♦LEFT TYMPANIC^ M^ (Filled in and 

complete labeled student's Handout.) 


2 


r . -3 . 


:^32-'': 


SCHEMA: MI DOLE EAR (Part of student's 








Handout filled In, no labels.) 

SCHEMA: MIDDLE EAR (More of student's 

Handout filled In, again, no labels.) 




L 



208 



D 



Week 

No. 



?. 



me 



Chapter 

No. 



A . 

^ r / i t* 

4 






' >1 .i, ; 



5 -.,,. 

> t 



^ i 



• » K { ' 



• i 






Slide 

No. 



34 



35 



36 



37 



40 



41 

42 



45 



46 



60 



68 



77 



. * <l I 

'...i^n: r:f. 



Title of Slide and Brief Description 



SCHEMA: MIDDLE EAR (Part of student's 

Handout filled in and labeled.) 

SCHEMA: MIDDLE EAR (Similar to slide 

34 with the sole exception that tije. . 
stirrup has b^en added to the oval 
. window, and is highlighted.) j 

i 

f 

SCHEMA: MIDDLE EAR (Partially completed 

student Handout and labeled.) 

*SCHEMA: MIDDLE EAR (Completed^stU(^ent 

Handout; alT parts labeled.) 



♦HAMMER (All parts of the hammer are 
labeled.) > 

♦ANVIL (All parts of the anvil are labeled.) 

♦STIRRUP (All parts of the ^stirrup are 

labeled'. I »' 

'O' . ;■ I .1 

♦OSSICULAR ARTICULATION (Various ligaments, 
membranes are shown, in red.) 

. I 

♦OSSICULAR ARTICULATION (The inwardiphase 
of sound is shown with orange arrows 
throughout.) : 

. ’ ’ { { - j • i 

♦OSSICULAR ARTICULATION (The outward 

phase of sound is shown with green 

arrows throughout.) ■ : : 



♦EUSTACHIAN TUBE SECTION (Similar to 
student's Handout with- all parts ! 
labeled;) 

‘ I ; j 

♦PHARYNk AND ADJACENT STRUCTURES 

(similar to studerit's Harjdout with 

all parts 'labeled; ) j 

\ 

•SCHEMATIC OF MOUTH (Slmilif to stud^^^ 
Handout with all part's: labeled.) i 



0 



D 



B 

B- 

B 
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Meek 

No. 


Chapter 

No. 


Slide 

No. 


, Oi'- 

Title of Slide and Brief Description 


2 


6 


9a* 


*LATERAL VIEW OF SUPERFICIAL MUSCLES OF 
FACE AND NECK - (Masseter and sternocleido- 
mastoid muscles shown) 


2 


6 


11a 


•LATERAL VIEW OF PHARYNGEAL CONSTRICTORS 
(Shows pharyngeal constrictors.) 


2 


6 


33a 


•ORAL CAVITY (This is taken from Netter 
plate #1 . ) ■ 


2 


6 


34a 


•PHARYNX (SAGGITAL SECTION) (This is i 
Netter's plate 16.) i 


2 

{ , •. 1 ; 

2 


6 

5 


35a 


•MUSCULATURE OF PHARYNX (This is ; 

Netter 's pi ate). #20. ) r , 


6 

f \ ' 


36 a 


•PHARYNX (VIEWED FROM BEHIND), (This IS 
; Netter's plate i#17;) ) ? 


i ’ 

2 


6 


37 a 


•MUSCULATURE OfVpHARYNX (VIEWED FROM 
BEHIND) (Netter's plate #21.) 


2 


6 


38a 


HI-'." , f - ‘ , ' * ’ , ' * ^ 

•MUSCULATURE OF PHARYNX (SAGGITAL SECTION) 
(Netter's plate #19.) : 


^ - : 


. ' 6 

^ ' / ' > ’ Of ^ \ 


39 a 


•ROOF OF MOUTH (VIEWED FROM BEHINDl ' 
• (sNetter's plate #5i) 


2 

f’ . * i* » r 

* V r i 


6 


40a 


•FAUCES (SAGGITAL SECTION) (Netter' si 
Plata #14.) ; i ‘ s 


2 


> t > 

6 


41a 


•LEAVtOR AND TENSOR MUSCLE SCHEMA ! 

; (Dr. Siegenthaler's drawing of thete ; 

muscles.) | ■ i 


2 


6 


42 a 


•EUSTACHIAN TUBE OPENING I (Velum lowered 


2 


6 


43a 


*EUSTACHIAN TUBE OPENING II (Velum raised 
Pass a vant ' s J>ar i s s hjown . ) 


2 


’t . » . 

6 

‘ * f' ; 


44a 


*EUSTACHIAN TUBE OPENING III: (Velum ; 
intermediate) 



\ \ 



•The “a" designates the second tray of sHcfes In the tAI Wdup:; 




Heek 

No. 



3 

3 



"'I 



3 

i ■' 



Chapter 

No. 












7 

7 



7 



'8'^ 



8 






a 



ui oa 



8 






8 



Slide 

No. 



Ida 



12 a 

4 \ 

13a 

14a 

15a 

16a 

18a 

19 a 



21a 
22a 
23a 

I ' ' 
, 

24 a: 

i 

25a 



Title of Slide and Brief Description 



♦SCHEMATIC or OSSEOUS LABYRINTH (S1jn?lar 
to student's Handout with all parts 
labeled.) 

COCHLEAR CANAL I (Long closed tube.) 

COCHLEAR CANAL II (Same as slide 12a 
with spiral lamina added.) 

COCHLEAR CANAL III (SaW as 13a with 
tube curved.) 

COCHLEAR CANAL IV (Same as slide 14a 
with tube helical.) 

♦COCHLEAR CANAL V (Slide as: 15a with, 
cone (modiolus) Inserted Inside helix.) 

♦MODIOLUS WITH EORAMINA (Similar to | 
slide 17a with cutout showing foramina 
In modiolus.) i 

^SECTIONAL VIEW OF COCHLEA (Cross section 

' of co'chlaa. ) , i ; 



i 



f , > 



MEMBRANOUS LABYRINTH I (Similar to stu- 
dent's Handout with 11 osseous parts 
to be labeled listed on bottom.) 

MEMBRANOUS LABYp.iNTH II (The parts given 
on slide 20a are now labeled.) 

NEMBRANOUS LABYRINTH III (Shows membranous 
vestibule with parts not labeled.) 

. < 

MEMBRANOUS LABYRINTH IV (Same as slide. 

22a with parts labeled.) 

MEMBRANOUS LABYRINTH V (Membranous' 
semi-circular canal added with parts 
not labeled.) 

MEMBRANOUS LABYRINTH VI (Same as slide 
24a with parts labeled.) 
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Chapter 

No. 



8 



8 



8 



8 * 



8 



10 



10 



11 



11 






Slide 

No. 



26a 



27a 



28a 



29a 



30a 



a 



50a 



51a 



52a 



53a 



54a 



Title of Slide and Brief Description 



MEMBRANOUS LABYRINTH VII (Cochlear Uuct 
added with parts listed but net labeled.) 

MEMBRANOUS LABYRINTH VIII (Similar to 
slide 26a with parts labeled.) 

MEMBRANOUS LABYRINTH IX (Spiral lamina 
added.) 

W,MBRANOUS LABYRINTH X (Similar U stu- 
dent's completed Handout with all 
parts addeo and labeled.) 

MEMBRANOUS LABYRINTH XI (CONNECTIONS TO 

BRAIN) (Similar to student's second 
Handout showing osseous ^connections to 
brain cavity, no parts labeled but parts 
are listed. ) 

♦MEMBRANOUS LABYRINTH XII (CONNECTIONS TO 

BRAIN) (Similar to slide 30a with all 
parts 1 abe led. ) ^ - 



WHICH WAY IS DOWN? (Man's head with 
maculae shown In utricle and saccula.) 



♦SCHEMA OF COCHLEAR CANAL (Similar to 
student's Handout with all parts 
labeled.) 

♦ORGAN OF CORTI (Similar to student's 
Handout with all parts labeled.) 



♦SCHEMA OF COCHLEAR NEURON CONNECTIONS 
(Three pathways of VIII N. neurons 
are shown In cochlear canal.) 

♦MAJOR TOPOGRAPHY OF BRAIN (Five lobes 
of brain with other prominent features 
shown. Lateral view.). 
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1 



Week 

No. 


Chapter 
No^ . 


Slide 

No. 


Title of Slide and Brief Descriptiojf» ’ 


4 


1 ,11 !... ■ 


i S5a 


^SEVERAL SPECIALIZED BRAIN AREAS (Broca's 
area» Heschel's area and Wernike's area 
are shown.) . 


4 


’iV . 


56a 

, / ^ 


♦ACOUSTIC sifSTEM I (Similar to student's 
Handout and no parts labeled.) 


4 


"'ll" * ' 


57a 


♦ACOUSTIC SYSTEM H (First Order neurons i 

shown.) 


4 


n . 


58a 


♦ACOUSTIC SiYSTEM III (Second order 
neurons shown.) 


4 


. ^ V ) 

i * ' ^ - V ■ ' 


59a 

* \ ‘ 


♦ACOUSTIC SYSTEM JV (Higher order neurons 
shown.) 

1 


4 


12 


1 


r ' ■ i 1 

NO ANATOHICAL SLIDES 1 


. 4; i' 


' "f ~i ^ ' 

* ' 1 1 ^ * , 


' » ' V *? 

, .. / 

^ - V* ? ' 


t.' - < ^ V ^ ^ ^ j 

. NO ANATOMICAL SLIDES , ; ' ] 

* ' 1 A 

' ' V ^ ^ , 


... .. 


- 




4 " ^ 1 



u 



, \ 



i < . 












f < : 



'> i 



r*. ^ 



■ ‘ V 






H 







' i 



's 
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Appendix D.3 



Sample of Speech Pathology and Audiology CAI Program 



Label 0£ Code Argument 



This section is tsken from the 
fourth chapter of spa430; Chapter 4 
covers the contents and functions of 
the middle ear. The sample program 
below demonstrates one of the ways a 
student is guided by a series of 
questions to complete an anatomical 
Handout. It tells the student to fill 
in his Handout unaided - then shows 
the student a slide of a completed 
Handout - and finally asks the student 
to question . the computer on the items 
missed. This procedure is intended 
to sliow a studant to proceed at the 
pace hp requires, while presenting 
all of the material to all of the 



This generates extra spacing 
between typeouts. This format helps 
separate items within the program. 



ty 4-1. We have just completed a schematic 



representation of the boundaries of the 
middle ear cavity. The problem for hearing 
Is to get "sound” across the region of the 
middle ear cavity from the eardrum to the 
oval window. So far this linkage Is not 
complete. Now we shall complete It by 



students.* 



rd 

f h 

fn » I I uc/ / ' 

ty ,, (linefeed) ,, 




means of the ossicular chalh. 



*N. B. All material Indented to this position represents 
author's explanatory comments about the stored computer program. 



Argument 



,,( linefeed) , , ; 

Have you read pp. 18-21 in Newby? 



kw//l 
/ yes 



An example of keyword processing; 
the slash (/) is used as a delimiter 
to separate keyword responses. The 
computer searches the student s re- 
sponse for a grouping of letters 
''yes.‘' If "yes" is anywhere in the 
response, the following is typed 
out • 



Now pay special attention to p. 19. Fig. 2-4 

take the three plastic ossicles; 

them carefully and compare them with Fig. 

2-4. The lenticular process of the incus 
is distorted in the sketch. However, for 
our purposes, both the sketch and the 
olastic ossicles are from a right ear. 

Study the names of the various parts oj 
each ossicle until you think you know them 
fairly well. Then close your book and 
press ^ EOB 



kw//l 

/no 

Do it now. Type yes when you are through 

reading. 

wait//30 

Xhis prevents the student from 
proceeding for 30 seconds; presumably 
sufficient time to ‘‘stimulate the 
student into doing the required reading 
assignment , 

Type either: yes (or) no . 
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Label Op Code Argument 

ty , .(linefeed) ,, 

ty The next Handout is intended to show the 

ossicles of the right ear in their approxi« 
mate relation to each other but disarticu- 
lated. Along with your Handout, have on 
hand the three plastic ossicles and Newby. 
Press: EOB when you are ready to begin. 

The student is referred to^his 
Handout, which contains a sketch of 
each of the three honta in the middle 
ear (ossicles). On the Handout, 
lettered extension lines point to each 
of the parts of interest. Below each 
ossicle is a list of parts. It is the 
etudeht*s responsibility to match the 
’ part with the line. 



! 



; 



o 

ERIC 

hiaifaifftiiTi-Taaa 



rd 9999 

ty , .(linefeed) 99 

ty 4-2. Consider the hammer. Using words 

found in the list below the sketch of the 
hammer, fill in those lines (A-H) that you 
are very sure you kppw. You may leave some 
lines blank for now. i^or your own benefit, 
don't do this by the process of elimination. 
Press: EOB when this is completed. 





fn 


wait//15 


4-2 


rd 


9 t 9 9 




ty 


,, (linefeed) ,, 




, fn 


slideZ/da 



Slide 43 

'■ ■: .u>. j 

’1. If you canhbt identify all the labeled 
^ : parts of this ossicle, type the 1 e tte r 

: of one unlabeled part. Material will 

then be presented to help you fill In 
the unlabeled part. 







Label Op Code 



Argument 



S1id6 43 (cbnt*d) 

* * ' ’ . I . ' . ' ' ' 

i2. Repeat Step #1 a^ often as desired, 
" 3; When all parts of this ossicle are 
labeled, type i g6 on 



9U; 

ca go on 

When the student has labeled all 
.the.pai^ts of the ossicle, he types: 

, go on (see slide 43). Upon typing 
gp on; the follpving is typed out 
and slide 40 is. shown, followed by 
tape message 85. 

ty Compare your Handout with the following slide. 

fn , sl1de//40 



‘ Slide 4o; 

; this slide shows !a siketch of the ossicle the 
■ student has just completed, completely 
labeled. 



fn tape//85 



Tape Message 85 

Check your Handout with the slide. Notice 
that the names of the parts of the hammer 
make sense. For example, the head of the 
hammer Is attached to the neck. The llga- 
^ . i i ; mpnts and processes are names for the 

: direction toward which they point. 

i : ^ r ^ 

• ’ ' > V ^ 1 * ' ■ ^ ' ‘ ^ * 

ty ,, (linefeed) ,, 

fn tape//86x 



o 



Label 



Og Code ArsuKient 
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nx 

fn 



nx 

fn 

ca 

fn 

ty 

br 



nx 

fn 

ca 

fn 

ty 

br 



sb///nxl//aO///al pha 

If the studeut ha3 not typed "go 
on" he will be asking for information 
about one of the parts of the 'Ossicle 
(see contents of slide 43) • this 
statement is a subroutine used to make 
sure that the student's response con- 
sists of one letteri only. The: student 's 
response cannot be further processed 
until this criterion* has beenVmet. 



kw//l 

/a 

slide//43x 
,v( linefeed),, 
hmrra 




The above set 



of six statements 



processes the one letter response of 
t!ie student to, see if the letter "a" 
is typed. The, combination of the 
subroutine (previously described) 
and the keywords processing in,, this 
set makes it possible- for a student 
to . type any variati.o^; of the letter . 
"a" and still be recpgni^ed. (a a. 

A A. -a) are examples of what would 



be recognized as .correct 



kw//l 

/b 

sl1de//43x 
,,( linefeed) ,, 
hmr-b 



\ zu 



Label 




Code ArquRient 

Since the first ossicle, the 
hammer, has eight pa?ts, the proces 
sing of student responses a through 
^ h take*' place in the same way. 




fp s1ide//43x 

br hmr-h 




fn kw//l 

wa /i/j/k/l/m/Ji/o/p/q/r/s/t/u/v/w/x/y/z 

The purpose of this keyword pro- 
cessing is to itisure that the student 
typed a letter that is in the repetoire 
of responses. Here, the letters 
• through ^ have no meaning as a response. 

’’ ' ty* ' * ' Yoh should have typed a letter referring to 

- ' ^ ^ the hammer ; You didn't. Try again. 

' un ^ Read the slide. Type: go on if all parts 

- of tha hammer are labeled. If not all 

/o' i labeled, type the letter of one ur.labeled 

... - : , : V ^pa>t; ■' ^ \ 

qu If you have made an error or two and would 

like some help, type: help 

If your labels are all correct and you are 
ready to proceed with the anvil, type: anvil 

This £U can only be reached by the 
student who has completed the first 
ossicle and is ready to proceed t^) 
the second one. At this point, the 
student is given another oppoirtunity 
to go over the parts of the first 
ossicle (by typing HELP). The student 
also may proceed to the second ossicle, 
the anvil, by typing ANVIL. 



Labe) Op Code Argument 



hmr-a 



nx 

fn 

ca 

br 

nx 

fn 

oa 

fn 

ty 

br 

un 



qu 



nx 

fn 

ca 

ty 

fn 

br 

un 



pa0//2//50 

help 

4-2 

pa0//2//60 

anvil 

sl1de//43x 
,,( linefeed),, 

4-3 

Type either: help 









(or) anvil 



Here we start the processing of 
the eight (a-h) Inforinatlon seeking 
responses the student. can make. After 
the student has been through the 
series of statements that contain 
information on the part desired, the 
computer goes back to shoving slide 
43 and processing the student ^s 
response again— as often as desired. 

Part A Is the topmost part of the malleus. 
Note that It Is the part of the hammer that 
''strikes” the anvil. What part of a hammer 
strikes an anvil? 



Label A as head 



kw//l 
/head 
Correct. 

wa1t//5 ' 

4-2 

A 1^ the topmost part of the malleus, 
is your topmost part? 



What 



. 

ERIC 
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Label 



hmr-b 




Op Code Argument ^ 

The un response Is typed out to the 
student vheneyer he responds with 
something unanticipated by the author* 

y ! .* - , 

' . ' “ 1 v» ^ 

un Incorrect. Try again. 

un Try: head 

Type it. ‘ 

Here is similar processing. |or 
student response: b 

qu Part B represents a Tigament. Which one? 

RX • \ 

fn kw//l , ' 

ca / lateral 

ty Correct, 

fn* tape//86 

/ fh : t^ ^ ^ 

fn wait//5 

^ ' ' br'.:'.',';. 4-2 ■ 

* ' wa sideward 



The is an example of a possible 
• anticipated wrong response. If ’’side- 

' ' ward" is typed by the student, the 

following is typed out. 

ty Correct. However, answer the question again 

using the more technical anatomical term 
for things going to the side. 

' * ' ' V ,■ 

nx ; 

fn kw//l 

wa /up/ for 

• > . j, 

* ; This wa is processed with keyword. 

Therefore, all student responses 
starting with the letters "up” or-. 

"for” (e.gy, up, upward, forward) 
will have the following typed out. 

ty Incorrect. Look at 6 and at the word list. 

Try again. 



Argument 

There are only thre^ ligaments on the list 
of. terms below the hammer. Does 6 point ' 

, forward,, sideward, or upward? .'ry again. 

What term(s) bn tN lii?t^r^ to a ligament 
pointing to the tl^e? Try! again. 

Type : ' 1 ate r al 1 1 gament " 

similar processing occurs for 
student responses £ through jg. 

Part K Is an area specialized for contact 
with a second bone (notice the dotted line). 
What does H refer to? 



kwo//2 



The correct answer to the above 
question must contain at least two 
words in the correct order . The 
function kwo (keyword £rder) matches 
a student’s response when it contains 
the words "facet” and "incus" in that 
order no matter what else is typed 
before, between, or afterwards. 

* . f t 

/ fatet / Indus 

Correct. 

tape//89 

tape//90x 

wa1t//5 

4-2 

The special name for this area Is "facet." 
Try again. 

This is the beginning of a similar 
presentation on the second ossicle. 



m 



Argument 




Og, Code 

. .^“3* Now consider the anvil. Following 

the same procedure that yoU used with the 
, hammer, fill In only those lines (I-H) 
that you are very sure about. You may 
J6®ve some lines blank for now. For your 
r benefit, don't do this by the process 

of elimination, ii/hen you are ready to 
proceed^ press: EOB, 













0 

0 : 

0 

0 

0 

0 

Q 

0 

D 

0 ; 
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Appendix D.4 



Flow Chart and Interpretive Notes 
for the First Part of SPA 430 



OUTER EAR BLOCK 



MIDDLE EAR BLOCK 



I 2 H » 

NO 








YES 




TEST BLOCK 



INNER EAR BLOCK 



KEY TO FlAW CHART 

1. Sign cri . Type:- start Press: BOB 

2. Introduction to CAl SPA 430 

3. Overview of outer ear 

4. "Do you want to skip outer ear?" 

5. Outer ear subprogram 

6. Did student make > 33% errors on pinna? 

7 . Remedial subprogram on pinna 

8. "Do you want to cover piima again?" 

3. Did student come from Test Block (Outer Ear}? 

10. First question on middle ear 

11. Did student make > 33% errors on pinna? 

12. Overview middle ear 

13. "Do you ' nt to skip middle ear?" 

14. Middle subprogram 

15. Did student make > 50% errors on middle ear? 

16. "Do you want to cover middle ear again?" 

17. Did student come from Test Block (middle ear)? 

18. First question on inner ear 

19. Did student make ^ 25% errors on the last time 
through middle ear subprogram? 

20. Overview of inner ear and temporal bone 

21. "Do you want to skip inner ear and temporal bone?" 

22. Inner ear and temporal bone subprogram 



23 . Did student make ^ 50% errors on inner ear and 
temporal bone? 

24. "Do you want to cover inner ear and temporal bone 
again?" 

25. Did student come from Test Block (inner ear and 
temporal bone)? 

26. Did student skip outer ear subprogram? 

27. Test on outer' ear 

28. Did student make ^33% errors on outer ear test? 

29. "Do you want to take outer ear subprogram?" 

30. Did student skip middle ear sub{Mrogram? 

31 . Test on middle ear 

32 . Did student make > 33% errors on middle ear test? 

33. "Do you want to take middle ear subprogram?" 

34. Did student skip inner ear and temporal bone 
subprogram? 

35. Test on iimer ear and temporal bone 

36. Did student make > 33% errors on iimer ear arid 
temporal bone test? 

37 . "Do you want to take inner ear and temporal bone 
subprogram?" 

38. "Do you want to ask any questions?" 

39. "Type your questions" 

40. On with the course. Proceed to chapter 2 : Detailed 
' Anatomy of Bar 



o 




Appendix D.5 




3/66 



Sample student Handout for SPA 430 
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^ Appendix £•! , : i 

SUPPLEMENTARY READING ASSIGNMENT : 

(To accompany Chapter 9 of Keller-Ferrara Text) 

As Indicated In the “Instructions for Chapter 9,*‘ you were 
not required to read the section entitled “Basic Entries In 
Standard Cost Systems." The first section of the supplementary 
reading, assignment Is Intended as a replacement for the above 
section of Chapter 9. The second section consists, of a brief . 
discussion of the spoilage variance . 

Journal Entries Under Standar d Cost Systems 

The method of recording standard costs in the. accounts , as 

set forth below. Is generally referred to as the single plan . 

Under the single plan, work In process Is charged (debited) With 

standard cost of operations (expressed In terms of equivalent 

units) completed, and work In process Is credited with standard . 

cost of finished goods completed. Separate accounts are main- , 

2 

talned for each of the variances. Standard cost journal entries 
as Illustrated below are based on data previously presented In. 
the section of Chapter 9 titled “Calculating Var1ances--A Com- , 
plete Illustration." 



*5 

Terminology same as that appearing In Accountants Cost 
Handbook, 2nd Edition, Robert J. Dickey, Edi tor ( f he Ronal d Press 
Company 5 New York, 1960), Section 16. 

And be careful to note that the “best" method of calculating 
variances Is employed at this point. More specifically, only one 
variance Is used for variable factory overhead (I.e., the variabTe 
overhead efficiency variance) and two for fixed factory overhead. 
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The problem Involves a manufacturer of "gadgets" who has the 
following standard cost for each 10,000 units produced: 

Haterlals: 10,000 pounds 0 $0.0005 per pound. . . .$50.00 

Labor: 40 hours 0 $2.00 per hour 80.00 

.Variable factory overhead 0 $0,30 per standard 

direct labor hour 12.00 

Fixed factory overhead @ $0.20 per standard 

direct labor hour , 8jj0 

. V.; f ; \ TOTAL STANDARD COST / $TTOcF 

During the year 50,000 units were manufactured; normal volume was 
calculated as 220 dirdct labor hours. The following data appear 
in the records: 

(1) Purchased 60,000 pounds of materials at $0,004 per 
pound. 

(2) , Used 52,000 pounds of materials (actually costing 

fOt04 per pound). 

(3) Actual direct labor hours worked amount to 190 at 

a rate of $2.10 per hour. nn 

(4) Actual variable factory overhead amounted to $76.00. 

(5) Actual fixed factory overhead amounted to $45,00. 

A complete set of journal entries to reflect the above data 
in the accounts Is presented below. While work in process is 
both charged and credited at standard cost, the variance accounts 
serve 2S a reconclliatibn bf ^'actuar and standard costs (since 
by cl’osiTig the variance accounts Into work in process prior to 
transfers, the account will be converted to "actual" costs). 

Varl ance cal cul ati ons have been omi tie d since they are Identical 
to those appearing In the section titled "Calculating Varlances-- 
A Complete fllustrat|^ i 



' , ! 'i ^ t ' < 

V i 
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( 1 ) 

To record purchase of raw materials* 



Dr. Raw materials Inventory (@ std. cost). .$300.00 

Cr. Haterlals price variance . . . . $ 60.00 

Cr. Accounts payable . . ... . . . « . . . . . 240.00 



To charge raw materials Inventory account for actual 
quantities of materials purchased at standard cost, to 
credit accounts payable for actual amount due creditors, 
and to debit or credit materials price variance account 
for the difference. 

(Notice that the variance accounts may be debited or 
credited depending on facts given In the problem.) 

* Under the single plan , raw materials Inventory Is carried In the 
accounts at standard cost. In view of the responsibility ' 
accounting concept It Is preferable to record the materials price 
variance on the basis of actual purchases so that the time lag 
between purchase and usage does not obviate the control slgnirl- 
cance of this variance! Regretfully, In some problemVsltuations 
data with respect to purchases are not given In which case the 
materials price variance must be calculated cn the basis of 
amounts requisitioned. In the above example, the alternative 
takes the following form: 



Dr. Work In process (@ std. cost). . . .'. .$250.00 
Or. Materials usage variance ........ 10.00 

Cr. Materials price variance . ........ 

Cr. Raw materials Inventory (0 actual cost) V . 



$ 52.00 
208.00 



(Obviously, raw materials Ihvehtory Is carried iri the 
accounts at actual cost If recording of the materials 
price variance Is deferred until the date of requisi- 
tion or usage. Note also that the materials us age 
variance Is also Included In the above entry.]"' 




To record raw material s requisitioned 



Dr. Work In process (0 std. cost). ; . . . . 

Dr. Materials usage variance 

Cr. Raw materials Inventory (0 std. cost). 



$250.00 

10.00 

.H . .$260.00 



To charge work In process for standard quantities of 
materials allowed vor production meeting standard 
requirements, to credit raw materials Inventory for 
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actual quantities used at standard costf and to debit 
or credit materials usage variance for the, difference. 




(3) 



record direct labor 



Dr. Work in process (@ std. cost) 
Or. Labof rate variance. ... . 
Cr. Labor efficiency variance 

j:r. Accrued payroll. ... * 



$400.00 

19.00 



$ 20.00 
399.00 



To charge work in process for standard quantities of 
direct labor allowed for production meeting standard 
requi rements $ to credit accrued payroll for actual 
(grosO amount due workers, and to debit and/or credit 
labor rate and efficiency variance accounts for the 
difference. 

I ! " \ 1 ^ ' * ' ' _ , 

;■ ' „ . ' ..(4a) . . ■ . 

' To record actual variable factory overhead incurred 

br. Variable factory overhead (control 

account). ........ • .$76.00 

Cr. Appropriate asset, valuation or 

contra and liability accounts $76.00 



(4b) 

h record actual fixed factory overhead i n currM 

Dr» Fixed factory overhead (control ^ 

^account) . c • . .$4t>.u0 

Crri r < Appropriate asset, valuation or _ 

, ; cpntra anid liability accounts. . . . . . .$45.00 



Ij 9L record variable factory overhead applied to productipn 

Or. Work in process (0 std. cost). . . . . .$60.00 
Cr. Applied variable-.factory overhead. ,. . . ,$o0.00 

: . To cfiarge work in process for standard quantities of 
variable factory overhead allowed for production meeting 
;,standard,,requ1 rements and to credit applied variable 
factory overhead control account for same amount. 
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(5b) 

To record f1 xed factory overhead applied production - ^ 

Dr. Work In process (0 std. cost). . . . ^ .$40.00 _ 

Cr. Applied fixed factory overhead . . . . . .$40.00 

• To charge work in process for standat*d guanttties of 
fixed factory overhead allowed for production meeting 
standard requirements and to credit applied fixed 
factory overhead control account for same amount. 

> *r:vw-' . . ‘ ^ 

;w.:. .-.r,;: ^ ^ . v ' : ;r- ! i : 

To reflect variable factory overhead efficiency, variance 
In the accounts ‘ 

Or. Applied vaVia^^ factory overhead. . . .$60.00 
Dr. Variable factory overhead efficiency 
‘‘ Variance ^ . . .' . . . .■ . • • • • ; •16.00 

Cr.. Variable factory overhead (control nn v 

^ ’ account) . . . . . • • • • • • • • * • • •$/o*uO 

To close "actual'' and "applied" variable factory dvCr- 
head accounts and debit or credit variable factory 
overhead efficiency variance for the difference. , 

(Notice that the difference between the two variable 
overhead accounts always represents the variance 
under this method of recording the entries.) 

(6b) 

To reflect fixed factory overhead variances In the accounts. 

Dr. Applied fixed factory overhead . . . . .$40.00 ^ 

Dr. Fixed factory overhead volume 
» variance . . . . • • • • • • • • • • • 4.00 

Dr. Fixed factory overhead budget 

variance . . . ... . . • • • • • • • l*oo ' 

Cr. Fixed factory overhead (control 

account) .... V. . . . .... ... .$45.00 

To close "actual" and "applied" fixed, factory over- 
head accounts and debit and/or credit the difference 
' ' to the app.r0pr1’atg variancie accounts . .{Notice that 

a closing of these accounts yields a "net" variance. 
Thus, formulas for the fixed factory overhead budget ^ 
and volume variances must be used In order to calculate, 
'the gross amount of each variance.) 
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(7) 

To record transfer o1 uni ts completed to finished goods Inventory 

Dr. Finished goods inventory (0 std. cost) . .$750^00 ; 

;Cr.^ Work in process (0 std. cost). .. . . ^ . . . .|750.0C 

; > To record coi^pleti on of 509000 units at a Svandard cost 
V^of $150.00 per 10,000 units. 

When the gadgets are sold, finished goods inventory should be 
credited and cost of goods sold debited for the standard cost of 

units sold. . - ^ - -■ 

NOTE: .! A FIRST STEP IH RECORDING ENTIRES UNDER A STANDARD 
COST SYSTEM TAKES THE FORM OF bETERHINING STANDARD PRODUCTION 
WITH (RESPECT TO EACH OF THE COST ELEMENTS. GENERALLY, ONE FIGURE 
IS GIVEN IN PROBLEM SITUATIONS WHICH INDICATES THE NUMBER OF 

' ' i' 

STANDARD UNITS OF OUTPUT PRODUCED DURING THE ACCOUNTING I*.ERI0D! 

The Spoilage Variance . 

This section (of the “Supplementary Reading Assignment" for 



Chapter 9) should be read after you have studied the section of, 
the chapter which Is titled "Additional VariancesT-The Spoilage 
Variance.** An important conclusion to be drawn from that section 
is this: Accounting for spoilage under a standard cpst system 

achieves the same results as similar procedures under an "actual** 
or histor.ical iCOSt system. That is, spoilage must be classified 
as being. either normal (or expected), or abnormal (or. unexpected) . 



Costs ^associated with normal spoilage are reallocated to good 



i S':; '• 



units produced, whereas, costs associated with abnormal .spoilage 
are treated as a loss in the income statement for the period. 



ERIC 

— 
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A special spoilage variance account may or may not be 
included in the accounts for a standard cost system. Consider ' 
the following example where it Is first assumed that no spoilage 
variance account is maintained and second that a special spoil*- 



age variance account is maintained: 

Standard Cost of Producing One Hat : 

Materials: 2 yards of straw 0 $0.50 per yard. 
Labor: 1 hour ^' $1.50 per hour. . i . • . . 

Variable factory overhead 0 $0.50 per standard 
direct labor hoar. . . .- . . . . * • • • • 

Fixed factory overhead 0 $1.00 per standard 

direct labor hour . . . •• • . v . ♦ i ^ . 

STANDARD COST OF PRODUCTION BEFORE 

— mKPiW r~ . . '. ... 

Add on normal (standard) spoilage allowance 
of 1 0% . . . .Vi . i . . '. < . . . . . 

STANDARD COST OF PRODUCTION INCLUDING 
AUOHANCE FOR NORMAL (STANDARD) SPOILAGE 






. $ 1.00 
1.50 



RA 

• W V 



1.00 

$4.00 

0o40 

$4.40 



The following data appear in the records: 

(1) 120 hats were manufactured: 100 meeting standard 

requirements and 20 unacceptable. 

(2) Used 250 yards of straw 0 $0.53 per yard. 

(3) Actual direct labor hours worked amounted to 125 0a 
rate of $1 .60. 

REQUIRED ; Calculate all variances for which data are available. 

(1) 

Calculations Assuming No Special Spoilage Variance 

A review of the above data indicates that the following variances 
can be calculated: 

(1) Materials price variance 

(2) Materials usage variance 

(3) Labor rate variance 

and (4) Labor efficiency variance 



When a special spoilage variance Is not used, It Is necessary to 
work. with the number of standard units produced-^ln this case. 
100 hats. Notice that the standard cost of production after 
adding, the 10% allowance for normal spoilage amouifits to $4.40, 
This means simply that the physical standard has been Increased 
by 10%. (and consequently the standard cost). 



Calculations assuming that no special variance 

Is used for spoTlage 

(1) Materials price variance -- (SP-AP)AO 
($0,50 - $v053) 250 yards = $7150 
<t2) Materials usage variance -- (SQ-AQ)SP 






’ * ^ I 






[2,2 (IDOj - 250]$0,50 
= (220 r 250) $0,50. ,1; 






•; =$15,00(0) 

‘{3) Labor rate variance (SP-AP)AQ 

: ($,1;50 - $1,60) 125 hours = $12,50 (U) 

(4) Labor efficiency yariance --(SQ-AQ)SP 

[1,1(100).j125]$1,50 . 

= hlO - 125)$1,50 , : 

= $22,50(0) 



i 



Calculations assuming that a special spoilage variance i^ used 

(1) Materials price variance -- Same as above; Why? 

(2) Materials usage variance -- (SQ-AW)SP - 

[2(120). - 25,03$0,50 

= (240 • 250)$0,50 ' 

= $5.00.(OV;„ , - ,i,. 



Alt' 



(3) tabor rate variance -- Same as above; why? 

(4) Labor efficiency variance -- (SQ-AQ)SP , 

(120 - 125) $lc50 - $?--50 (U) v . 



' 'Denote an unfavorable variance by (U) and a favorable 
variance by (F). 



(5) Spoilage variance -- (Actual spoilage • standard 
spoilage) Standard Cost Before Spoilage 

(20-10) $4.00 - $40.00 



HOMEWORK ASSIGNMENT: 

(1) Kow Is abnormal spoilage treated In a system where a 
special spoilage variance Is not used? 

(2) Explain the differences In the usage and efficiency 
variances under each method. 

(3) Why Is Standard Cost Before Spoilage used In the 
formula for the spoilage variance? 

(4) Record all entries (for which data are available) 
under both methods. Remember that units completed 
are transferred to finished goods at a Standard Cost 
which includes a spoilage allowance . Why? 




Appendix E.2 
Case Problems 



STANDARD COSTS— ACCOUNTING PROCEDURES 
(Instructions for Chapter 9) " 



In addition to reading Introductory matirial Included In 
Chapter 9, study the following sections very carefully. Omit 
all sections which are not listed below . 

(1) The Variances of Standard Cost Accounting 

(a) Direct Materials Variances 

(b) Direct Labor Variances /*\ 

" - (c) Variable Factory Overhead Variances' ^ ‘ 

(d) Fixed Factory Overhead Var1ances--The Budget • 

'•.’■’V Variance * *. 

(e) Fixed Factory Overhead Var1ances--The Volume 

Varlance^*^ 

^"^In addition to learning formulas and how to calculate all of 
the Variances It Is necessary to know the BEST variances for both 
variable and fixed factory overhead costs. Notice that the sum 
of the two variances which are “discarded" In each Instance yield 
the BEST variance, I.e., the variable overhead efficiency ..Variance 
and the volume variance for fixed factory overhead. 

(2) Calculating Var1ances--A Complete Illustration) 

(Also study Exhibits 9-1 and 9-4) 

(3) Calculating Transfers and Ending Inventories 

(4) Standard Costs for Individual Areas of Responsibility . 

- (5) dob-Order Standard Costs 

(a) Procedure for Building Standard Costs 

(b) An Illustration: (In order to minimize confusion^ 

It may prove beneficial for yoti to reread 
Section S(b) and rework the example by utilizing 
journal entries and other procedures as discussed 
In the SUPPLEMENTARY READING ASSIGNMENT for ; : 

Chapter 9.) In other words, consider carefdlly’' 
the last paragraph In Section 5(b), which points 
out the method of recording journal entries as * 
set forth. Ifi the above-mentioned "Supplementary . 
Reading Assignment." 
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( 6 ) 



( 7 ) 



Special Issues In Standard Costing 

(a) Additional Var1ancas-.-The Spoilage Variance (See 
also the SUPPLEMENTARY READING ASSIGNMENT for 
Chapter 9.) 

(b) Disposition of Variances (Relate this section to 
questions in Chapter 8 concerning accounting treat- 
merst of “over- or underapplied" fixed factory 
overhead under each available ineasure of capacity.) 

Appendix A--Alternative Approaches to Fixed Factory 

Overhead Variances 



STANDARD COST VARIANCE ANALYSIS 

A fundamental conclusion of Chapter 9 (Keller-Ferrara text) 
Is that seven calculations are necessary to accomplish an ele- 
mentary levef of standard cost variance analysis. Consequently, 
the folTpwing formulas are to be used for problem solution in 

this course. 



MATERIALS 



-LABOR 

(a) Rate or Efficiency variance (SP “ ^nlcp 

(b) Efficiency or Quantity. . •* » . . . . .U>M • 

VARIABLE FACTORY OVERHEAD EFFICIENCY VARIANCE^ 

(a) Actual variable factory overhead - Standard 

labor ^ factory 
hours* overhead 
rate 



(a) Price variance. .......... • " aoI^p 

(b) Usage or Quantity variance. . . - . • «v5Q - aqjjh 



Note that this formula Is the algebraic sum 
actory overhead variances which are explained in paragraphs 
wo aiid three of page 204. The explanation which supports use 
rthe abow%?rmSla 'Is given on pp. 204-205. Read It with under- 
tanding*/ ’ 



... *Or^v#hatever measure of activity the "standard allowance 
for acceptable production is to be expressed. 
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FIXED FACTORY OVERHEAD VARIANCES 



(a) Budget variance . . . « (Budgeted fixed factory 

overhead " Actual fixed 
factory. overfeed) ; . ■ 



(b) Volume variance 



(Normal volume' - Standard 

hours^) Standard fixed factory 
overhead rate ^ ^ 



^Of whatever the capacity concept be1h9 usedt however expressed* 
notice also that the volume variance forinujA given above 
represents the algebraic sum of the two fixed factory 
head variances shown at the bottom of page 207. Reasons for- 
preferring the above formula are set forth on page 208. 

indicate^ by the use of £ or U designation, whether variances 
are favorable or unfavorable when you solve problems. 



- 
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HOMEWORK PROBLEM NO, 1 
Chapter 9 



Calculating Variances 

Assume the following data concerning one month; 



Actual Manufacturing Costs Standard Manufacturing, Costs Applied 



Materials (1000 units 

^ $ 6 ) 6,000 

Labor (3200 hours 
0 $2} r:. V : 6 ,400 ^ 

Vdflftblfi ov®rh 6 , 5 id 4^^00 - Variable ovcrHaad (3250 hours 



Materials (1100 units 0 
. $5.90) 

Labor (3250 hours 0 $2.10) 



6,490 

6,825 



Fl3?ed overhead 



0 $ 1 . 20 ), 

4,200 Fixed overhead (3250 hcurs 

0 $ 1 . 20 ) 



3,900 



20,700 



3,900 

STtlTS* 



REQUIRED:* 
Calculate (1) 



Price and efficiency variances for materials 
and labor. 



*( 2 ) 

(3) 



Efficiency variance for variable factory overhead 



Budget and volume variances for fixed overhead 
costs (hours of capacity for the month are 3400). 



(4) 



Total up the seven variances to see If they are 
equal to the difference between actual and 
standard costs (21,115 - 20,700 = 415). 



^*^Use the "best" isethod for calculatiog the overhead variances. 










Appendix E.3 

Course Outline for Accounting 102 « Spring Terin, 1966 
Field Test Project 
Group 1: Lecture Group 

Will be ip attendance at all class meetings (MWF 1) with the 
professor i Dr. Cramer. 



ASSIGNMENT AND OUTLINE SCHEDULE 

Date Perl od Topic . Assignment 

4/4 1 Lecture-Administrative 

4/6/ .2 Intro, to Mgmt. Acctg. Chap. 1: Horngren* 

Chap. 1; Keller & 
Ferrara*’*^ : . 

4/8 3 Accounting Concepts Chap. 2: Horngren 

& Terminology Chap. 2: Keller & 

. , Ferrara .. . . 

Review: 2-2,5,6,12 ' 

Do; *2-19 K a F 



4/11 4 Lecture - Responsi- Chap. 3: .JK & F , 

billty Accounting Review: 3-2, 3»4 KaF 

Do: 3-14, 17, 15 

,K & F 

4/13 5 Cost-Prof1t-Volun;j Chap. 3: Horngren 

; Relationships Review: 3-1, 3, 4 H 



4/15 
4/1 8 



6 

t ^ 

7 



Break-even Analysis Chap. 3: Horngren 

Do; 3-8,9,13,14 , H 

^ ♦ / * I 1* V > ' ' ' ■ 

'I 4 

, Lecture-Cost Accounting Chap. 4: K ft F 

Cycle Review: 4-2, 4, 5, 7, 

8,10 K ft F 



4/20 , 



8 Cost Accou‘.it1ng Cycle 

t 



Chap. 5: . K ft F , ^ 
Review: "5-4,5 ,6 ,7,8, 
19 K ft F 



Date Period 



Assignment 



4/22 
4/25. 

4/27 
4/29 

5/2 

') \ 

5/4 

* /> 

/ 

5/6 

■» « 

5/9 

% * 

5/n * 
5/13 



Topic 

9 Cost Account; !ng Cycle Chap. 6: K & F 

Review: 6-2,7,9,10, 
11,18 

10 Lecture-Equivalent Chap. 4: Horngren 

Units & Spoilage (especially Part I L)^ 

Calculations and Handout Reading 

As$1gnment-Chap. 7. 

11 Job Order Costing System Chap. 7 pp. 131-142: 

. . - t 6 F. 

Do: 7-21 

- 12 Process Costing System Chap. 7 (remainder) : 

K & F 

■ Do: Homework Problems 

No. 2 and 3 for Chapter 

• ; 7 of K a F (handouts) 

13 Lecture-Process Costing: Chap. 7: K & F 

Capacity Concepts Do: Homework Problems 

. J ‘ 3 a 4 (handouts) 

14 \Process - Costing Chap. 7: K a F 

Do: Homework Problem . 

5 for Chapter 7 K a F 
(handout) 

15 EXAMINATION AlL PREVIOUS ASSIGN-, 

; MENTS 

16 Lecture - Separation of Chapt. 7 pp. 193-198 

, . Fixed and Variable and 207-216: Horngrpn; 

\ Costs Handout Sheet 

Do: Handou« Problem a 

7-?3. 25 H 

17 Standard Costs Chap. 8 pp. 171-184: 

K a F 

Review: 8-5,9,8,10, 

V 11. K a F . . 

Do: 8-25 K a F 

18 /Standard Costs Chap. 8 (remainder): 

K a F 

Review: 8-13,14,15, 

K a F 
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Date Period 

5/16 19 

5/18 20 



5/20 21 



5/23 22 

5/25 23 

5/27 24 

5/30 25 

6/1 26 

6/3 27 

6/6 28 



Topic 

Lecture-Variance 

Analysis 



Accounting for Standard 
Costs 



Accounting for Standard 
Costs 



Lecture-Direct Costing 



Lecture-Direct Cos^;rng 



Cost Control and* 
Flexible Budgeting 



Lecture-Cost Control & 
Flexible Budgeting 



wecture-Cost Data for 
Business Decisions 



Lecture-Cost Data for 
Business Decisions 



Lecture-Budgeting and 
Financial Planning 



Assignment . - 

Chap. 9 pp. 201-211 : 

K & F 

DO: 9-17 and Handout 
Problem 

'Chap. 9 (remainder): 

K & F 

Do: 9-27, 30 K & F 

Supplementary Reading 
Assignment for Chapter 
9 

Do: 9-19 and Handout 

Problem 

Library Reserve Read- 
ing Assign. Johnson 
Paper of Direct Cost- 
ing 

Do: 24-17 K & F 

Chap. 24: K A F 

Do: 24-20 K & F and 

Handout Prob. „ 

Chap. 10 & 11: K & F 
Review: 10-3,8,10, 

11,21 K A F 
Do: 11-28 K A F 

Chap. 12: JC A F > 

Do: 12-18,20 K A F 

Review: 12-1,2,7 

K A F 

Chap. 13: K A F 
Review: 13-11,14 

K A F 

Chap. 18: K A F 

Do: 18-10,11,19 K A F 

Review: 18-20a K A F 

Chap. 15: K A F 

Review: 15-2,7,9,11, 

12,13 K A F 

Bo: 15-18,19-22 K A F 
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Date 


Period 


Topic 


6/8 


29 


Lecture-Budgeting and 




Financial Planning 

1 A''. 


6/TQ 


30 


Revl ew , 7 Re-analy s1;S 


6/1 . 


C?1 / ' - 


FINA'. EXAMINATION 






Assigmnent * 

Chap. 16: K & F 

Review: 16-2, 3o4, 7, 

8,12,13 JC & F 

Review ; ; 

PREVIOUS MATERIAL: 
Emphasis on material 
of periods 13-30. 



0 



0 



n 

U 



' v;* . M > 






K;; . / 



'"I K ‘ ' 


1 * ' 
f 


1 - 


1. >■ > 








' 1 1 






- 




S ‘ 


^ i a{ ^ " ' 




J . ; > ^ 

V 




















fl 


. . •■ - 




'» '*1. 




















I 




i Ks' 






















4UI 









^ ' L 















\ - i % 



i ; ^ i 



; I ;.r I 



> V , /i 



■ :;,v 



V’t V f' i i‘ ' -• • ■ 

I > ? ?* ;J » C. ■ > £ 



5 j 



\ J 1' f '■* J ' 



:t ^ 









A 



0 ! 



1 !-. 



1 



1 1 i 



■ ir^h/: : 
• r ;‘. > ’i 



't ■- '■• \ 

■•V '•■ r . ? ,. 




0 
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Field Test 



Group 2 : CM Group 

Will be In attendance at one class meeting per week (all Noniays 
of the term): two class meetings (equivalent time) will be spent 
at the teaching terminal In the CAI Laboratory (201 Chambers 
Building) » with exception of those periods designated (periods 
23, 26, 27, 29, and 30) during the week as -‘Lecture** when these , 
students will meet In class as Indicated at the regular class 
time. All regular class meetings are designated *'Lectur8** and the 
students should meet with the professor In dess at those times 
(period 1 MUf). 

Assignments and Course Outline : 

The outline and assignments for. Group 2 are the same as those for 
Group 1 with the following exceptions: 

Date Period Topic Assignment 

4/4 1 Lecture-Administrative C.A.I. Warm up and 

s ‘ manapref scheduled 

< C at V your convenience . 

Week of ] V 

4/4 - 4/10 2,3 Complete Nanai 

4/11-4/16 5,6 Complete Nana2 

4/18-4/24 8,9 , Complete Hana3 & 

Maha4 

Homework Problem II 
for Chapter 3 : 

4/25-5/1 11,12 Complete Hana5 & 

5/2-5Z8 &14 Mana6 

■ \ t " Period 15 - Examination 

5/9-5/15 17,18 Complete Mana7 

5/16-5/22 20,21 Complete NanaO 

5/23-5/29 24 Complete Nana9 

Remainder of the term;^ the class meets together In the regular 
scheduled class periods. 



Accounting 102; Spring Term, 1966 
Field Test Project 




Group 3 : Self "Study Group 

VHU be In attendance at one class meeting per week (all Mondays 
of the term); two class meetings, (equivalent: time - 2 • 

hours) will be spent at the Curriculum Materials Centerj, EPC 
Room 401. It Is Important that this group spend a minimum of 
2 1/2 hours per week In supervised self-study activities. The 
course outline and- assignment schedule for Group 3 is the same 
as for Group 1 with the following schedule of additional reading 
assignments to be read during supervised self-study perlodsi :? 
All handouts will be placed In your folder. 



i Week of ; 
4/4-4/10 

4/11-4/16 



Additional Assignments to be read , 

N.A.A. Bulletin, June, 1963, Sect. 3, pp. 3-14 
Cljap. 1 In Beyer; Chap. 1, 2, & 3 of Anthony 

Pp. 3-6; 27-34 In Blerman 

Chapte r 1 2 • i n Mel s ch « i ^ 

NAA Research Report Analysis of Cost-Volume- 
Profit Relationships, pp. 85-94 In Shllllnglaw 



4/18-4/24 






4/25-5/1 



5/2-5/8 



ff/f-5/15 



'V t 



Chap. 4 In Horngren pp. 193-198; 251-260 
Horngren 

‘Restudy Chap. 1-6 In Keller & Fetrara \;- 
Appendlx 101-110 Horngren 



Chap. 3 Shllllnglaw 
2 :^ pp. 102-106; 112-131 Shllllnglaw: 
pp. 328-338 Shllllnglaw 



Complete Homework assignments 

Review for Examination 

Chap. 2 Wright i; : ; 

NAA Research Bulletin - Separation of Fixed 
and Variable Costs 

^ Chap. 1 and 4 in Gillespie -2 



5/16-5/222 » 
5/23-5/29 

i >,<• A- 



! Chap. 2 & 3 In Gillespie 
Chap. 7 In Shllllnglaw 

Class on 5/25 

Re study Chapv 1.0 & 1 1 1 n X & F y 
Chap* 8 In Shllllnglaw ^ : -2 : t ! 



Remainder of Term; Meet with the entire class In lecture, 

period 1 MMF. 



Appendix E*4 

BOOKS AVAILABLE IN C.A.I. READING AND SELF-STUDY CENTER 



Curriculum Materials Center - EPC II, Room 401 

(1) Shllliinulaw -- Cost Accounting ; Analysis and Control 

(2) Beyer, Robert -- Profitability Accounting for Planning ^n^ 
Control 

(3) Wright, Wlltner -- Direct Costing 

(4) Blerman, Harold -- Tonics In Cost Accounting and Decisions 

(5) Anthony, Robert -- Management Accounting ; Text and Cases 

(6) Gillespie, Cecil -- Standard and Direct Costing 

(7) Welsh, Glenn -- Budgeting : Profit Planning and Control 

(8) Horngren, Charles -- Cost Accounting ; A Managerial Emphasis 

(9) N.A.A. (N.A.C.A.) Research Reports: 

“No. 37 on Direct Costing** 

"Separation of Fixed and Variable Costs" 

"Analysis of Cost-Volome-Profit Relationships" 

(10) Other Materials Available: 

Set of slides to accompany the Computer Assisted Instruc- 
tion Course, and accompanying tapes. Tape segments 
(distinguished by loud beep tone) generally follow the 
slide numbers. A chi^nge of tapes Is necessary for slides 
above no. 27. 

Handouts, Exhibits, and Displays for Computer Assisted 
Instruction Course will also be available. 
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Appendix E.5 

0 rv' 

Sample of Introtiuctory Management Accounting CAl Course 



SaroDld Program \ 
Label 6^ Code 



int6-/2 



int5-3 






; . 



f > 



jk1 



A' 

^ j i ; 



rd 



Id 



nX; 

fn 

ca 






ty 

ty 



i::, 



Argument 

The material In this section Is mainly 
introductory In nature but should also 
serve to acquaint you with the job order 
costing system. Press EOB when ready to 
proceed. 

l//s3 . 

Th« first rd stateiieiit is ;• 
used to check the student’s 
. preparation Ctor this chapter* 

, The Id statement sets an interuCl 
binary counter (switch) for later 
branching japd review.* 

What are the two basic co^t accounting ; 
systems? 

. 1 ^ " . ' • * ' - ‘ ’ 

$ » job , ,order i land ^ .process , ^ : 

\ A ]^,>f unction witb^f (feed- 
the reaponse as 
'^CQTxe^t when it matches the 
;Spe cl fled -number words in the 
ca . The feedbacl >^?!ars only 
if tlie ca is match* i ~ 

Correct! 9 , t 



^satisfied) • 

u ' „ - 



i’iThe job order cost system* and the 
process cost system are the two major 
';tyges,; 






AJI aaterlal Indented to this position represents 
author's explanatory comments about thp stored computer program^ 



. 

ERIC 



Label Op Code Argument 

% ■» </ . < ' , . ‘ ^ ^ * 1 - • r >'* * '' * 

^ ^ ‘ V ' » ' > ^ V r ^ V , I V < . ‘ 1 ' V . ' " 

* ? V ' J- 

un Did you make a spelling error? Try again. 

un Incorrect* Pages 131-142 pt (Cp^Jer and. 

Ferrara should have been ri^ ad before-* - 
signing on for this course section. 

br glk 

’ 4* i > ^ 1 i i #*< * i ' V X , ^ *. / I < » 

\ , » ' ' ' ? ' p t * ' r' - ‘ , ' * U' 

’'‘if 'the student responds 

; ^ ' ^ ■ incorrectly twice, he is told that 

’■ “ * his preparation is unsatisfactory. 

He is then branched to glk where 
the correct answer is presented. 

He then proceeds to the next question. 



i n't 6 - 4 ’ - ‘‘ • ■ rd ’ - . ' ■ -•; ' - -■ ■- - ■■ 

* : q - ty Job order system is used if goods are 

' ^ ■ prodaced'to customer specification; 

“ " • ‘ process costir*' is used if goods are pro- 

duced for stock. 



retests ‘ fd 

ty 



Id 



' .V,.: K‘p \ 

■ ' ' r /v N "p* 'j < , 

There are six basic entrfes in an actual 
or historical cost systems" Entries must 
be made for actual as well as applied 
factory overhead. " 

0//S4 ^5-' 



'r ' V In the following questions we shall test 

your knowledge of these basic journal 
entries^ Use the basic form, including 
' , the- dr^ and cr. designations. 



l 




•cl //cl 



1 A 






> 'V j ) 



Id 




0//S5 ' 

the ^ ( load) statement sets * 
internal ‘switches ; while the ad 
(add) statement clears an internal 
counter for the check sequence 
following. 




What is the basic entry to-recdrd Hhe use 
■■of 'di feet '-mater i ai S? ■ ‘‘ - ■’ j ■' 





zu 



Label 


Op Code 


Arqunent 




nx 


- 




fn 


pa0//6534//65 


,♦ * 1 


ca 


dr. work In process, cr. raw materials 
1n\rentory 




ty 


Okay 



partial-answer function 
(paO) .with feedback will check 
sequential strings of 6, then 5» 
and then 3 letters of the student’s 
response and accepts the answr<sr 
if 652 of these strings are 
mat che d exact ly • 



fn pa0//43r//85 

wa dr. direct materials 

. ty Your answer Is not Incorrect* but neither 

Is it acceptable. What account Is debited 
(or charged) to reflect direct materials 
and direct labor during the production 
process? Try again. 

un Less than 65% correct. The correct 

answer Is dr. work In process, cr. 

■v:-. ‘ .’-'Try again. 

ad l//cl 

The second partial-answer 
function checks for one half of 
the entry; if the student's 
'.response matches this half of 
the entry and not the entire ca, 

« r t , a hint is provided to the student 

for his next response. Note that 
a 1 is added to counter 1 for this 
.V ?: ■ ;. < • :-r. .■ '-error. 



;V ' ‘ 

fn paO//6Mr//85 



Argyment 




cr* accrued payroll at 

You have tlie credit portion correct, and 
the debit portion was stated In the last 
entry; both are debited d1^*ectly to work 
In process. Enter the correct answer. 



1//C1 



/The third p art answer 
function is activated only if 
tlie> first two are unsatisfied 
on’ any try. 

The entry records the direct labor costs 
as: a portion of the cost accumulated for 
the goods as they are processed; It Is 
debited to the work In process account. 
The amount of total wagps Is recorded by 
the credit to accrued payroll. 



;'i>f:ittone.‘-'of the thr.ee pre- 
ceding functions are satis- 
fiedv ^he first ^ statement is 
wriu:ta^^ The student then , receives 
a hint' cf or each part of the entry. 
Again, 1 is added to counter 1 for 
this '^e'rror'o- .. ' fp- ^ 

Ttie answer Is: dr. work In process, cr. 

accrued payroll. 

1//C1 

•1-nw6-!6 4 . 






student's second 
response is entirely incorrect, 
he Is’ given the ca and proceeds 
in the program. Again, a 1 ie 
added to counter 1 for this 
error. At the end of the entire 
check sequence, the counter (cl) 
provides an accurate >aucumulatlon 
of the number of definite student 



crrorsV ' ’Att ^appropriate feedback 
to the student is given on the 
basis of this information. 





Exhibit 73 
TIhapter y) 

RecapHulatloit for HoBtework Problem No. 3 

(manaS) 



The work In process account. In effect, represents a modified 
COST OF PRODUCTION REPORT. 

The account looks like this: 

WORK IN PROCESS 



Debit Side 



Costs to be accounted for : 



Beginning Inventory of 4,000 units 

100% complete with respect to ma terials . . . . 
75% complete with respect to labor and 

overhead • • 

Current costs 

Direct materials . . c . . - 

Direct labor and factory overhead . 



T OT Alw 



$ 2,400 

1,500 

22,000 

18.000 



Credit Side 

Costs accounted for as follows ; 



Units transferred to finished goods 

Inventory (or next producing department) . 
Costs Included In ending work In process 
Inventory (6,000 units) 

100% complete with respect to materials. *. 
30% complete with respect to materials . . 
Rounding error 



$39,140 



3,300 

1,440 

20 






You have learned the procedures for process costing when only 
one department Is involved and work In process Is present jt 
the beginning and end of the period. The average cost method 
was used for making the required calculations. The same problem 
will now be considered using the first In, first out method. 
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Engineering Economics CAI Course 



Page tio> 



F.l Course Outline for Engineering Economics 261 

F.2 Sample of Engineering Economics CAI Program 263 



COURSE OUTLIME FOR EN3INEERING ECONOMICS 
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Appendix F*2- 

iainple of Eriglneering Economics CAI Program 






LabeT Op Cdde 

b102-10-0 fd 
fn 



Argument 



s1ide//27 



Slide 27 

ILLUSTRATION 02-V 




' \ , 



fn 



wa1t//7 






,*r'; 






. 



. 

ERIC 



5»g-^*F^iSai 



I 1 

Loue I 



Jp Cods 



bl02-10-5 rd 
fn 
fn 



■Argument 

student 1# allowed 7 seconds to 
examine the slide before the instruc- 
tion proceeds* The contents of the 
slide will theu >e explained by tape,^ 
messages and typewriter print' out •* " 



tape//27 

tape//28x 





qu 

ca 

wa 

br 



Tape Message 27 > ? j 

' f 

A fixed cost Is one that remalijs ,#t the same 
level as production increases decreases. 

A variable cost is one that vafies directly 
-is the production level variesj 
trgued that this is an artificial cl assiM- 
dation. and that no cost is strictly fixoa 
Or variable. Conversely it may be argued 
“mathematically that any curve has a constant 
pleiiient even though it may be zero. 



|eob) 



bl02-10-5 



' ^ the studdnt mky hear the tape message 
again by typing a small ”r” for repeat. 
Any other student response will allow 
the . etudettt to proceed wit|i the inst^ 
tlon^ 



*M. 

author’s 

pram. 



i 






All material indented to this position represents 
xplanatory comments about f)e stored computer pro- 




m 



Label Op Code 


Araument 


b102-10-10 rd 
:ty- 


In illustration 2- V equation (1) is C 5Q 
and equation (2) is C « 50 + 1.00. Both, 
lines have a slope of 5 but they differ in 
where they cross the ordinate. Equation 
(1) is said to be all variable cost; and. 
equation (2) is said to be a mixture of 
fixed and variable costs. 


qu 


In slide 27. what variable Is plotted on, 

the abscissa? 

' * ' 1 


nx 

fn 

. ... ^ c-r _ . . 

i I'l r , J ^ ’ 


KVf/./fo 

flevellprpduction 


V' \ ' r ^ 

V . yi; « . 


The studedt response will be 
accepted if it contains the keywordc 
' level and /productionv The symbol i 
i« a delimiter, used, to separate the 
keywords . _ , 




Correct. 

J ,b102:.35^: 


fn 


kw//l 

cost 

i]Ko^: tbe cost is plpt^ the ordinattf. 


un 

'-•■J ,1 “O • . 'c • ' 

, - .'-'v - 


The student's answer Indicates that 
he has: a misconception concerning the 
abscissa and ordinate. The^ next inf or 
mation he receives will be the first 
un bel'dw'. ■ - '' 

Apparently you do not understand graphing 
V terminology . You will now be given some 
instruction on the meaning of abscissa and 


.. jr ' VC, 

' - , « i A* . . \ i * 


;; a j&;rdi nate 
b102-32-0 ■ 

V V > - V . - . 



^ Students who do not understand the 
■ tteehing of abscissa and ordinate are 
b¥anchdd to remedial instruction* 
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Label 


t)D Code 


Argument < . ; 


b 102-^3$ 

' * i - ■* 


. qu 


What 1$ the dependent variable In graph 27? 


h " ’’ 


»nx 




\ 


'•;:fn 


■;kw/yi , ' ; 




V;Ca-'-;’ 


-3lCQSt#CQSt " ■ " 3.;, 


* 


ty 


Correct ; 




■"-'-br''' • 


;:bl02-*41 : V. 




nx 






fn 


kw//l 




ca 


|level#product1on$Level#Product1bn 




ty 


Wrong, the level of production determines 
the cost. 


Kf ‘J \ ' 
* 


r-,, / .♦* . . 


YOU do not understand the meaning of' 
independent and dependent variables. You 
most learn these meanings. 


- 


br 


bl02-35-l 



bl 02-41 



qu 






n* 

fn' 

ca 

ty 



r' V 



»> a 



Students not understanding the 
meaning of independent and dependent 
variable are branched to remedial 
instruction. 



i/ 



^ ‘/I fv, 









At 50* capacity a certain cost Is $3,i 
and at 80X capacity,, this same cost is 
$4*200. Wbat Is thb equation of this cost 
curve? 



kwlb//6 

#ci«l40#q#+flpp: V 

Very good 

•d ^bis corrett tebponse is c * 40q + 100. 

The kvio function^ makes sure that the 
characters in the student *s response 
are in the propef;, order and that there 
are no extraneous characters in the 
retpouee. Careful programing allows 
ySrlatlon in .tb® format of the stu- 
dept*s response, (i.e.» capitalisation 
and spacing are not considered). 



« fir 




Label Og. Code 
br 

un 

br 



b102-42 qu 



nx 

fn 



ty 

un 

un 

ty 

br 



b102-43-l rd 



ArquBient 

mmmmrnmmsitvmrmmmmMmmm 

b102*42 

Wrong. Old you use the correct equation 
for slope (y » mx b) and adapt It to 
this special case? Try again. 

Wrong. Let us Investigate the problem In 
more detail. 

bl02-41-l 

Students who ere unable to obtain 
the correct response in two attempts 
are branched to appropriate instruct 
tlon. 

What is the cost of this operational func- 
tion at 60% capacity? 

ed//#//,//#// //#3400//3400.//3400.0//3400.00 

If the student v^ses a comma in his 
response to indicate the thousands 
position, the c:>mma is edited and only 
the numerical characters are compared. 
Spacing and the # sign are also edited 
from the student's response. If the 
student responds with either 3400*, 
3400.0, or 3400.00, his answer ia 
replaced with 3400. 

Correct. C*40 x 60) +1000 * 3400 

Incorrect. Are you using a slope value of 
40? 

Still not correct. 

C*(40 x 60) + lOOG * 3400 

You need more practice. 

bl02-42-l 

Students having trouble are branched 
to practice problems. 
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Appendix 6.1 
Hath 200 

OUTLINE OF TOPICS 
Spring Tertn» 1966 



April 5 


1 


Test 






April 7 


2 


Sets 




. Mavmathl 


April 9 


3 


Relations. . . . 




. Mavmath2 


April 12 


4 


Discussion 




• 


April 14 


5 


Exponents; numeration. . . 


. MavmathS and 4 


April 16 


6 


Number bases . . 




. MavmathS 


April 19 


7 


Number bases . . 


, 


. MavmathS 


April Z1 


8 


Discussion 






April 23 


9 


Addition . . . . 




. MavmathS 


April 26 


10 


Addition . . . . 




. MavmathS 


April 28 


11 


Discussion 






April 30 


1? 


Subtraction. . . 




. Mavmath7 


May 3 


13 


Subtraction. . . 




. Hvavmath7 


Hay 5 


14 


Olscissslcn 






Hay 7 


n 


Multiplication . 


• * 9 0 • 


. MavmathS 


Hay 10 


16 


Multiplication . 


9 • . * • • 


. MavmathS 


Hay 12 


17 


Discussion 






Kay 14 


18 


HI dterm ^ 






Hay 17 


19 


Division . . . . 


• • • • e 


« Mavmath9 


Hay 19 


20 


Division . . n . 




. MavmathS 


Hay 21 


21 


Integers ... * 


• • • • • 


. MavmathIO 


Hay 24 


22 


Discussion 






May ZS 


23 


Fractions. . , . 


• • • • e 


. Mavmathl 1 


Hay 28 


24 


Fractions. . . . 




. Mavmathl 1 


May 31 


O 


Discussion 




*- 


June 2 


26 


Decimals . « . . 




. Mavmathl 2 


June 4 


27 


Ratio Si . 


# a • • • 


. Mavmathl3 


June 7 


28 


Real numbers , . 


• e • • 


« Mavmathl 4 


June 9 


19 


Discussloss 






June 11 


30 


Test 




A 



-'1 



& , 
ERIC 
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Appendix 6*2 



Report on the Development of a Test 
for Modern Mathematics 



, I 



The test was developed to serve as a pre- and "post- test meaii^ure for the 
experimental course on modern mathematics (modmath) via Computer Assisted 
Instruction. The modnath course consists of 14 chapters, including concepts 
of sets, relations, numeriiti on systems, operations on whole numbers, integers^ 
rational numbers, and real numbers. The test was designed to provide a repre- 
sentative sampling of content from each, of these chapters. 

Content validity is postulated on they following bases t; 

1 ) An outl i ne of concepts whi ch are devel oped i n each of the 14 chapters 
of the modmath course was prepared. A tentative proposal was made of the 
number of knowledge, understanding, and application items which should be 
written for each chapter for initial trial. A group of approximately 25p 
items was prepared, using the concept outline and the proposal of types of , 

2) Texts in the field of mathemati cs education were, used in developing 
the course r and these were consulted in writing the test items. jAmong these 

texts were: x';,,- 

a) Mueller, Francis J. Arithmetic, Its Structure anj Cfflgepte 
Englewood Cliffs, New llersey: Rrentice-Hall, Inc. , 1964. 

b) Peterson, John* A. and Hashisaki, Joseph . Theory of Arithmetic, 

New York: John Wiley and Sons, Inc. ^ 1963,,; , , : r > 

c) Swain, Robert L. and Nichols, Eugene D. Understanding ^ 
metic. New York: Holt, Rinehart and Winston, Inc. 1965T 

d) Mard, M. and Hardgrove, C. E. Modern Elementary Hatheinatics. 
Reading, Mass.: Addison-Wesiey Publishing COi* inc^.-iisos. . 



, ■ 
ERIC 
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e) Webber, 6. Cuthbert end Brown, John A. Basic Concepts of ^athe- 
matics, Reading, Mass.; Addison-Wesley FuBTIsITing » 






f) Twenty-ninth Yearbook; Topics In Mathematics for Elementary 
School Teachers . Nati onsH iTouhHI' of Teacheri of hathematlcs , 



3) Dr. C. Alan Riedesel, Associate Professor in the DeparJ;ment of Ele- 
mentary Education, the Pennsylvann State University, and co-author of the 
modriiath course, read all items for applicability to course content. Approx- 
imately 50 Uehis were discarded, leaving a 206-item trial test. The final 
50-item test was drawn from these items, with selection on the basis of item 
analysis and content 'Sampling for representativeness. 

The analysts* chart for i^^^ on the trial test follows. 

The trial test was administered in two sessions to 40 students enrolled 
in one secticm of El. Ed. 326 (Teaching Arithmetic in the Elementary School) 
during the winter term. The test was administered during the regular after- 
noon class periods. This group was ‘^hosen on two bases; 1) These students 
had completed a course comparable to modmath (Math, 200), Their knowledge 
of the concepts taught would provide a basis for analyzing the usefulness of 
the items. 2) Availability of these students for the three to four hour^ 
necessary to complete the 206-item test. 

Two students were absent on the second day, so that data is based on 
38 students. This small number is definitely a limitation, particularly in 
obtaining discrimination indices. The appropriateness of this sample for 
analyzing for a niod^th course is questionable for several other 
reasons. The. fact that the students had completed the mathematics course 
previously meant that tM test was for them a measure of long-term reten- 
tion of concepts. They had taken Math. 200, not modmath, and had had 



R^««ivaluation 
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several different Instructors. In addition, their motivation might be ques- 
tioned, since they knew that the test woiild not affect their grade’s. (Their 
attitude nevertheless appeared to be very cooperative, which might be sub- 
stantiated by the number of items which all completed. They accepted the 
test as a possible diagnostic aid: it wbuld i.idicate areas in whijch tHeyJ - 
needed review;) ^ . . u. 

, - ^ ^ " I . ' t • : ! . C< < 

Answer sheets wdre machine-scored by Examination Services, and the item 
analysis was performed at the Computation Center. ! ; 

The range of scores on the 206-item test was fiiom 74 to 168, a 94- ^ 

\ ' 7 ^ ^ - , ^ ^ j 

point range. The mean equalled 122.05, with a variance of 425.83 and a^ stand-^ 
ard deviation of 20.64. Mean difficulty of the items was .592,' The distribu- 
tion of the test items in terms of the percentage of student^^^^^^ ' . 

: - 1 t 5 J.-. i , , i 

was: • ’ : . j : •: 

number of items 



T— - r. -J*. 

0 - 19 


14 ■; " ; ;i 


/■'* : r» : 

i 


20 - 39 ■ - 


33 


' 1 


40 - 59 . 


51 • i h 


» . . j 


60 - 79 


.58 ; 




80 100 


- ' " ' '' 50" i ' ' i: 





The distribution of the .test items in terms of item-total scor« cor- 
relations was: ■■■■' ' • - i;.:; 



■ • ( i 

— correl ations- - — 

I ,11 II, 

negative - .10 ! ' > 

i ^ : '.11 - ;.30i ; 

,31 <»-,50 . 

! = -,5rl ■- ..70 • '• : i 

, JiV- i.90' -V . ' ! 

; ,91-1,00 1 

The average item-total score Icorr^elati on was ,S04, :Th1^ is perhaps a reflec- 

s :: • r. ' _/ 1 ■■ ■; ; 4 ; i j ' ; ' ■ J ; ’ ‘ | ^ 

tion of the scope of. the content ion which! the test. Is based, Esti|rtated 



number of . Items- 

' ■--/45-. ' 

60 ^ 

- 65 

29 : 

7 i ; 

. :o ^ ... i 



4 



i 





Z77 



interltem correlation is *092., with a standard error, of correlation of *164* 
The distribution of scores is presented on the next pages in ungrouped .. 
and grouped form. 

' I 

The charts which follow show pertinent Information, taken fror^i the com- 
puter sheets, for each item on the trial test. The Kuder-Richardson 20 
reliability estimate is .916. No other reliability data is available on thd ' 
trial test. If a more approporiate sample had been available, other estimated 
tests of reliability would have been helpful.. No attempt was made to compute 
the reliability for chapter or subtest scores, since total test performance 
is to be the criterion for usefulness. Some analysis of the factors present 
in the test, plus , analysis of the reliabili^. of the subtest items, will be , 
made after use of the 50-iteni test. 



A Sut of criteria was developed for choosing 50 items from the 206 trial 



test: 



1) Difficulty index 
a) .50 to .70 

d) .40 to .49, and .71 to *60 



-*S 5 



2) I tern- total score correlation (discrimination index) 

a) .70:to1.00 

b) .40 to ,70 

3) Lower fifth-upper fifth comparison 

4) Content balance 

It was also found necessary to estabilish priorities for choosing items: 

1) Difficulty index a) - discrimination index a) 

2) Difficulty index a) - discrimination index b) ‘ r 

3) Difficulty index b) - discrimination Index a) 

4) Difficulty index b) - discrimination index b) 

5) Difficulty index a) « lower/ upper fifth comparison 

6) Difficulty index b) - lov/er/upper fifth comparison 



■m 



Frsquency dlsirtbuttorr of original scores; (H « 38) 



74-7 -• • 


109 . 


144 


7B 


no / 


14S 


76 


111 / 


146 


n ' 


" ' ii2 / ' ' ' 


147 


78 . 


113 // 


148 




114 /, , 


149 


80 


115 


150 




" " ' ‘116 


151 


- 


: 117 ■ 


152 


83-/,., 


: ns 


153 


84 


119 / 


154 


85 ' 


120 


155 


86 ' - 


121 / 


156 


87 


122 


; 157 


88 


123 


158 


.89 ■ / '' ' " 


"''124 


159 


90 


125 / 


160 


91 / 


126 /// 


161 


92 


127 // 


162 


93 


128 / 


163 


94 


129 / 


164 


95 


130 


165 


96 


131 


166 

« 1 


97 


132 / 


167 


98 


133 


168 


99 / 


134 /// 




100 


135 / 




101 


’l36" 




102 


i' W ' 




103 / / 


. m^ J 




104 / 


139 




105 


140 / 




105 


•• ■ -141 


■ 


107 / 


. 142 A.,. 




108 

T 


143 / 





/ 

/ 



/ 



D'j 
0 
0 
D 
0 
Ol 

D' 
D 

0 



. 

ERIC 
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Frequency distri bullion of grouped scores: (N ® 38) 



71 


- 


80 


/ 


81 




90 


// 


91 


m 


100 


// , 


101 


- 


no 


///// 


in 


- 


120 


////// 


121 


am 


130 


///////// 


131 


- 


140 


/////// 


141 


M 


150 


mt 


151 


m 


160 




161 


- 


170 


n 



Following this, crucial ity of content plus reasonable representative 
sampling by chapters were considered. Re-analysis disclosed duplications of 
concepts in a few cases, and other priority items replaced these. 

The next table shows the pertinent information about each of the items 
which coiTipose the 50-item test. A summary by subsections is also included. 

The average difficulty index of the final test is .670, which is slightly 
higher than the index for the initial test. This may be less ideal, but it 
seemed more desirable to have a representative sampling. The levels which 
the indices will assume when the test is used following a modmath course is, 
of course, a matter of conjecture. 

The ipearman-Brown formula was used to estimate the reliability of a 
final test which is one-fourth the length of the initial test: the expected 
r is ,732, This, however, presumes the same type of sample. 

Analysis of the value of the distractors resulted in some rewriting. 

This was not done in all cases, since sometimes no other distractors were 
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plausible, and since It is hypothesized that with other samples the present 

dtstractors might serve better® - 

The test will be used during the spring term field testing - of modmath. 
Another test, consisting of 40 items with difficulty Indices of .80 to 1.00, 
has also been selected from the original pool of 206 itens.. This will serve 

il 

as a means of selecting equivalent groups for the field test. 
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Ir< formation about each item on the final 50«item test 



I \ 



chap. 


Item 

# 


KUA 


topic 


diff. 


discrim. 


1 


6 


i K 


subsets: 

inclusion notation 


.789 


.464 




(0 




setbuil der: 
intersection 


.684 


.609 

r 




18 


A 


Venn diagram: 
intersection, U 


./89 






21 


A 


union 


.763 


.323 




23 


‘A 


subtraction: 
set of Integers 


.605 


.290 ; 


2 


24 


K 


Venn diagram: 
cardinal number 


.974 


,121 

(rewritten) 




31 


A 


“T" relation : 
properties 


.474 


.208 




33 


A 


“sameness" relation 


,73? 


.464 


3 

4 


3S 


K 

■i ^ ' 


exponents : 
division 


.658 


.480 


5 


41 

> 


u 


expanded notation: 
base five 


.579 


.540 




: 44 


U 


exponents: 

multiplication 


.500 


.508 




46 


u 


expanded notation: 
letters 


.684 


.459 


i 

> 


49 


ijj 


largest base six 
number 


.737 


.462 




'66 


K 


ordinals 


- .684 


.491 


‘ ' 


63“ ^ 


K 


counting: base eight 


: .684 


.612 : 




67 


;;a 


expanded notation: 
base six 


.553 


.403 




69 


u 

f 


base two to ten 


.605 


.489 



K' 



O 

ERIC 
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chap. 


Item 

# 


KUA 


topic 


diff. 


discrim. 




73 


A 


base two: addition 


.737 


.725 


6 


75 


K 


identity: addition 


.447 


.329 


7 

8 


77 


K 


terminology 


.579 


.456 


9 


81 


5C 


inverse: addition 


.605 


.201 




89 


U 


mod 9; addition 


.447 


.290 




91 


A 


properties: 
assoc. » distrlb. 


.605 


.264 




98 


A 


equal additions: 
subtraction 


.474 


.542 




102 


A 


base five: subtraction 


.579 


.482 




106 


U 


multiplication: 

distfib. 


.605 


,400 




111 


U 


multiplication: 

regrouping 


.711 


. .461 




112 


U 


multiplication: 

distrlb. 


.684 


.580 




117 


A 


multiplication: 

lattice 


.658 


.162 




123 


K 


exact division 


.737 


.539 




127 • 


U 


repeated subtraction: 
division 


.447 


.548 




132 


A 


quotient estimation 


.605 


.519 




133 


A 


partition division 


.553 


.383 


10 


137 


K 


member of set: integers 


.711 


.550 




141 


A 


i ntegers : subtracti on 


.763 


.522 


n 


144 


K 


def i ni ti on : f ract i ons 


.763 


,421 


12 

13 


146 


K 


equivalence class 


.605 


.575 




148 


K 


exact divisors 


.789 


.620 




158 


A 


LCM 


.474 


.477 




166 


K 


largest decimal 


.553 


.651 




172 


U 


fractions: commut. 


.816 


.730 




176 


U 


decimals: m^*lti plication 


.711 


.509 




178 


U 


decimals: 
line relation 


.474 


.484 



chap. 



diffc 



d1 scrim. 



Item 

# KUA topic 



189 

193 

195 

196 

14 200 

203 
206 



U ratio .737 
A percent .553 
A ratio .684 
A rate-pair problem .579 
K non-terminating dec. .474 
U nested Intervals .816 
A rounding . .553 



.597 

.361 

.587 

.544 

. 202 - 

.707 

.461 
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b) .40 to .70 

3) Upper-lower fifth comparison 

4) Content 
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Appendix 6*3 
ample of Study Guide 

Math 200 



Study guide 6 Addition 



1. 



2 



In Peterson & Hashisakii exercise 5.2. page 83. ||,* 3. 5 

exercise 5*5, page 88, 

V f O 

exercise 5.6, page 92, All 
, ; exercise 5^1 , page 104, 

Which of the following sets of numbers is (are) closed under 
the operation of addition? 



,) (5, 10. 15. 20. 

.») ®ven natural numbersj 
'c>' fodd natural numbersi’ 

Uj ■ 0*11 , 21 . : 31 . *V. 51 . . . 
(e) ; ^ ^ j '2 j 4*: 6 . >*>» 2P^ 






3. By means of a number line, show that 

a) 5 and 7 are commutatlus under, addition , 

'b) 4, 6, 3 are associative under 

'c) 4, 3. 0 are associative under addition 

Si eive one nonmathematleal illustration of asspcl stivlty; of 
lack of associativity. 

R es»en tie set of natural numbers and the^operatlbn 
®’ feJSSef'slar") which means “add the numbers it combines 

and Increase tl 't sum by one;" e.g. , 6 * 4 n ,3 u e, 
3*2*5«12. Is the set of natural numbers 

(a) closed with respect to *?J , ; 

(b) commutative with respect-to. 2. 

(c) associative with respect to *7 



O 
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Study Guide 6 -- continued 



7. Add by the “scratch” method: 

(a) 6,429 

-t» 2.857 



(b) 4,387 



8. Find the excess of nlias for the fol lotting: numbers by adding 
the digit-values* ^heck your work by dividing by 9. 

"-.(a) -71 ' 

0 Jb) 35 

(c) 88 

9o Add the following and check by three checks: commutative, 

associative, excess of nines* 



M 8,637 
5'i922 
3,872 

10. Add 632 + 879 + 643. Now make your answer Incorrect by 

(a) switching the digits around; (b) adding*"?? to the answer. 
“Check” your problem with these two Incorrect answers by 
the excess of nines method. How do you account for what 
happens? ^ ^ 

11. In the nuinber sentences below, tell whether A < 6, A> B, 

or A » B. ' 

(a) 14 + A * B + 10 

(b) 28 + A * B •** 34 

(c) 14 + A > 27 + a 



12. Given t.ie infinite set of counting numbers which are symbolized 
In order, as m, t, v, w, r, x, g., .*., where m, Is 

the Initial counting niTmber irnd^^lts* sITccessor Is t, whose 
successor 1$ s, etc. “ 



(a) Complete the following addition table: 





m 


t 


;,S, 


K 


m 




s 






t 










s 










„„K 








b 





I 




study Guide 6 -- continued 

(b) Is the set ***3 

{1} closed under addition? 

(11) cooiinutatlve und^r addition? 

(Ill) associative under addition? 

151 ve one example to Illustrate each of your 
answers. 



Read In Peterson & .Hashlsaki , pp. 81-92, 100-103. 
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Ar>pend1x 6.4 

Sample of Modem Hathematic^ CAI i^mgram 







Label Op Code 


Aroument 


5-5 qu 


When we add 1 to 99, we have 9 tens and 10 
ones. The 10 ones form 1 ten, so we have 
IP tens. How do we write “10 tens" with 
numerals? 


ca 


100 


ty 

un 


Correct 

Wnat number comes after 99? Type It in 
digits? 


ad 




V ^ ^ 

' ^ ^ ^ 
\ i. • • - -- / 


Tbla coding Illustrates tb.e use of 
'Counters; the number of incorrect 
responses is being accvtmulated and 
stered for a branching decision.* 


5-6 qu 


The 1 is now in the hundreds place. That 
means we have a three-place numeral. With 
. what numeral do we first use four places. 


nk 

■' i, fn ;V 




ca 


. 1000 .ne thousand. 1,000 


■V *' ' ^ ^ 


this keyword function will accept 
; . , as correct any yarlation of the correct 
ansWer - 1000, one thousand. One 
thousand, or* 1,000. The Uumber of 
additional words which are. typed by 
the student - as, for example, when 
he answers with a complete sentence — 

, is. immaterial. 


V "i' , ' ' X > 





*N. B. All mate fial indented to this position represents 
author's explanatory comments about the stored computer pro- 
gram. 
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Label Op Code 


Araument 


ty 

un 


Correct 

Think of the largest 3-place number - rlghtl 
999. Now add 1 to thiSt type your answer» 


ad 

5-7 . rd 




ty 

rd 

fn 

fn 

fn 


».ook at the slide. 

sl1de//37 

tape//34 

tape//35K 

A slide wMch contains a chart of 
the place value system is displayed. 
While the student looks at it» a tape 
message is played > calling attention 
to certain aspects of It. The x 
following the second tape number merely 
. indicates positioning of the following 

tape; it is not played at this time. 


5-7-b rd . 

'ty' 


Notice the relationship Involved In the 
place value system of base ten<? 


ty 


Since we cannot at this point write exponents 
on this machine, we Will write Its meaning 
In words. V 


ty 


Thus 1 » ten tp the zero power 

To ® ten to the first power 

TOO « ten to the second power, or ten squared 




What Is 1000 expressed as a power of 10? 
, kw//2 1 


ca 


.en. third. 10 ;3.cubed 

Here the keyword function will tcok 
for 2 words; thus it will eccejt 10 to 
the third power, 10 to the 3rd power, 
ten cubed, and seVerhl other veriables. 




^§3 



Op Code 

ty 

un 

ad 

un 

ad 

qu 



nx 

fn 

ca 

ty 

un 



ad 

dn 

ad 

td 

br 




Argument 

Ten cubed Is correct ^ 

Notice the order of the exponents ( 09 l» 2 )» 
Therefore* what would come after 10 squared 
or 10 to the second power? 

-1//C1 

The correct answer is "10 to the third 
power." Type this. 

-1//C1 

How would the next place be expressed in 
terms of exponents? (Since exponents cannot 
be typed in this chapter write it out in 
wbrds.) 

kw//2 

. 10 ,en. fourth. 4 

Ten to the fourth power is correct. 

A new place is reachedwith 10*000. This 
Is 10 X 10 X 10 X 10. Written in exponential 
-form, this is "10 to the power." 

',-i//ci; " V; , 

Type "10 to the fourth power." 

-1//C1 



reml//cl//4 ' i; 

fhis is a statement regarding a 
brancbing decision. If the contents 
of counter 1, with which incorrect 
^ ■ Responses have been, recorded* is 

grahtef than 4* then the student is 
branched to remi . That is* if the 
studenh has missed more thaii 4* nues- 
tions* some remedial work is suggested. 
^ if he missed fewer than 4 of the review 
questions 9 he Is’ branched on in the 
’ ■ program'.'- '■ 






Label Og, Code 



br 

reml 

rd 



5-9 



fn 



f n 

5-9-a c|t5 



ca 

cb 

wa 

v^b 



5-9-b 



un 

rd 

fn 

ftt 



I i I 

5-10 qu 




Argument 
5-9 ' ■ ■ 

You could prof it from some review of our 
numeration system. Read Mueiler* Chapter. 
3. Then press EOB 

sYide//3Sx 

tape//35 

tape//36x 

If you want to hear the tape again, type r. 
If not, just press EOB. 

(EOB) 

P 

r 

:'5-9':' 

> Many tapes contain InlEormation 

vhlch the student might need to 
listen to mote than once. He is 
allowed tO; chopse whether, he wants 
the repetition or not. 

■ V ’ \ i ‘ 

Type r or press EOB 



s1ide//38 

wait//8 

t This ”wai^t” function indicates 

that the next statement will not 
be typed until the slide nas been 
in position for B seconds. 



Suppose a group of persons in an Isolated 
location were all born with four 
on each hand. Mhat number base would these 
people probably have used? 



nx 





Label 



5-11 



5-12 



o 

ERIC 
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Ofi. Code Argument 



fn 


tw//l 


ca 


• 8 ,lgijt 




Correct 


f n 


slide//39x 


nx 




.'.••fn'., ■ ' 




wa 


.4iOur 


ty 


They might use base four - what other base 
might they use? 




When wrong andvbrs can be antici- 
pated, specif Icr clues or hints can 
be given to show why the answer is 
incorrect, or, as in this chse, to 
help the student answer correctly. 


un 

"•'"'f'. >•. -''v. 

' ' 


Think ft 'through more carefully: How many 

ffrtgeris db we have in atl? What base do 
we Use? What base would an eight fingered 
person probably use? Now type your answer. 


' ; un" ■ 


The inswer ill 8. ' Typo 8. ' 


qij* 


i^emember that base; ten Has ten single digits 
But how many wi IV bale bight have? 


nx 




fn 


kw//l 


ca 


.ight. 8 ' 


ty 


Correct 


un 


Base eight has eight single digits. Type 
eight. ^ 


rd 




ty 


Let's. try counting in base eight. 1, 2, 3* 
4, 5, 6^ 7, - and we need a digit to 
represent the cardinal number of. the empty 
set - 0. That's eight digits. 


ty 


If we add 1 to 7, we reach the sum 8 - but 
8 is not a digit in base eight. 
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label 



5-13 



5-1 3-a 



SfiEL Code 
ty 

qu 



nx 

fn 

ca 

ty 

ca 



un 



rd 
fn 
fn 
f n 
fn 
fn 

qii 

ca 

cb 

wa 



Arqutnent 

Recall what happens under the sarae circum- 
stances in base ten. 

Now write the numeral which means “one of 
the base and zero onfeSe” In base eight. 

When more than 3 or 4 lines are 
to be typed to the student;^ they 
ate generally presented in segments » 
using the (typeout) function . 

kw//l 

Correct 

10 

10 (eight) Is more definitive. However, 
we will allow either form as correct - 
Just remember which base your answer Is 

,'ini ■ ■; 

The number after 7 In base eight Is 10 
(eight), which means “one group of thve 
base (eight) and zero ones." Type 10 j _ 
(eight). ; 



tape//36 

tape//37x 

sl1de//39 

tape//37 

tape//30x 

sl1de//40x 

Type r or press £QB. 

(my 

P 

r ‘ 
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Label Og, gode Argument 

wb R 

bf 5-13 

un Type r or press EOB, 

5-14 rd 

ty Now study the number line on the next slide, 

fn slide//40 

qu What number should appear after 17 (eight)? 

nx : 

• > ' , » ■ • 

'fn V' kw//1 ’ ' 

' oa ■' 20 

ty Correct, 

ca 20 

ty Correct - remember ft is 20 in base eight, 

nx 

fn kw//l 

wa ,18 

ty Do we use the numeral 8 in base eight? 

One of the base and 8>more would equal 2 
of of the base. How should 2 of the base be 

written? 

un The numeral after 17 (eight) would represent 

2 of the base. How should 2 of the base be 
written? 

un The numeral after 17 (eight) would be 2 of 

the base or 20 (eight). Type 20 (eight). 

Several stateBesits ere sossetisee 
used to give Increasing specific clues 
or hints. Generally, the final un 
statement will tell the student the 
correct answer. 

J 

5-lS qu What numeral will follow 20 (eight)? 

nx ' ' ■■■ • • ■■ 

fn kw//l 



29B 




Label 



Op Code 


Argument 


ca 


. 21 


ty 


Correct 


ca 


21 


iy 


Correct - 21 


un 


The correct 



S-16 



correct answer. 



Notice the x*s on the slide. 

If you were to divide them into groups of 
eighitt how many groups of eight wo«sd there 
be? 



nx 

fn JCW//1 

ca s 3 chree 

ty Correct, ^ 

br S“17 

un Incorrect, 

" - br • • ' 5»16*1 ■ - 

If the student types the correct 
, . , euever» he is branched on to question 

17, lf> hcwevc^, he answers incor- 
rectly# he ^8 branched to a scries 
of questionb, varying in length from 
2 to 10# for additional help, 

5-16-1 au If you were counting the x's In base 10, 

how many x*s would there be in all? 



hx 

fn 

ca 

!sn 



qu 

nx 



kw//1 

, 2S"-" ■' - 

The correct answer (ten). Type ity. 

How Many 8's are In 25 (ten)? , , 




5-16-2 







tabol 

5-17 

5-18 



5-1 8-a 

A ^ 1 

5-20 
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Op Code Arguaent 

fn kw//1 ^ 

ca ..hree, 3 

un There are three 8*s in 25 (ten). Type 3. 

qu many ones are left over? 

nx 

fn kw//l 

ca ,ne, 1 , 

on correct answer is 1 or one. Type it. 

qu How would you represent the number in base 

eight associated with the x*s? 

nx 

fn kw//l 

ca .931 
ty Correct 

.-■’ca , ;■ ■' 

ty Correct - 31 in base eight. 

un How many groups of tho base (eights) are 

contained in the x*s? How many ones? 

Try again. 

un There are 3 groups of the base (eight) 

X. V ^ and 1 qne^. Type 31 (eight) . 

rd / 

fn slide//42x 

qu : Write the numeral in base eight which means 
“five eights and seven ones." 

fn kw//l 

ca 9 57 

ty Correct. 

un The correct answer should be 57 (eight), 

rd 

ty Recall the progression of place values in 

base ten-ones» tens* hundreds* etc. 
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Label 


Op Code 


Arnunent 






In base eight* place values are* of course, 
based on powers of eight. 






Study the place value chart on the next slide 




rd 






fn 


s11de//42 




fn 


tape//38 




fn 


tape//39x 




qw 


Mhat nuneral should be inserted In place 
of the A fn the chart? 




fix 






f n 


kw//l 




ca 


tixtyfour, 64 




ty 


Correct. 




Ui1 


The correct answer should be 64. Type It. 


5-21 


qu 


After 8x8 would cone 8x8x8. tfhat 
numeral should be Inserted In place of B? 




nx . 




‘ 


fn 


kw//l : 




ca 


t- 

CM 

If— 




ty 


,R1ghtn 




un 


8 X 8 X 8 or 8 cubed « 512. Type 512. 


5-21-a 


rd 


) :r , ‘ 




fn 


sl1de//43x 


5-22 


qu 


When working with other bases, we frequdiitly 
change a number from one base to another. 
What Is the value of 37 (ten) In base e1g^>^.? 




nx 


* 




fn 






ca 


, 45 




ty 


Correct. 




br 


5-23 




ca 


■ • • ; V - . : . ■ 




ty 


Correct, 37 (ten) * 45 (eight) 



o 
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label Op Code 



un 



br 

5-22-1 qu 



nx 

fn 

ca 

nx 

fn 

ca 

ty 

nx 

fn 

ca 

ty 



br 

un 



5-22-2 qu 



Argument 

5-23 

Incorrect. Let’s break the problen down 
into smaller steps. If however » you 
realize how to find 37 (ten) in base 
eight, type in the correct answer at any 

point. 

5 - 22-1 

Look again at 37 (ten), He are looking for 
a way of regrouping it in terms of eights 
or powers of eight. Hhat is the largest 
power of eight represented in 37 (ten)? 

kw//2 

, 3 ,ight,irsft 

O', ' \ ‘ ' 



, 8 , 1 ,irst 
Correct. 

kw//l 

,45 

Good for youl 37 (ten) « 45 (eight) 

Notice that 45 ie the answer to 
. the orlglnaX /guest - on, ”What is |jhe . 
value of 37 (ten) in base eight? 

If the student realises his error at 
this point, or during any of the 
succeeding remedial steps, he can 
simply type the febrrect answer and 
will be branched but of the remedial 
sequence. '• ' 

5-23 

The correct answer is «8 to the first power.” 
Eight raised to the second power oir 64, is 
not contained in 37. Type ”8 to the first 
power.” i 

How many groups of 8 are there in 37 (ten)? 
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Label 



5-22-3 



5-22-4 



Op Code 


Argument 


nx 




f h 


kw//l , 


ca 


,©ur* 4 


ty 


Correct 


nx 




fn 


kw//l 


ca 


.45 



ty 

br 

un 

qu 



nx 

fa 

ca 

ty 

nx 

fh 

ca 

ty 

br 

un 

qu 



5-23 



nx 

tn 

ca 

ty 

un 



Good for you.* 37 (ten) « 45 (eight) 

5-23 

8 goes into 37 four ti^es. Type four, 

Kake a place Value chart for base eight on 
a piece of scrap paper. Write 4 in the 
eights column. What is the remainder when 
you subtract 4 eights from 37 (ten)? 



kw//l 
,ive, 5 
Correct 

kw//l 

,45 

Good for you! 37 (ten) « 45 (eight) 

5-b 

4 eights * 32» 37 - 32 * 5, Type 5, 

Since there are no eights in this remainier, 
this indicates the number of ones remaining. 
Write 5 in the ones column, Noisf read the 
number. What is 37 (ten) in base eight? 

kw//l 

: ;'45 , , , ... . 

Correct - 37 (ten) * 45 (eight) 

37 (ten) « 45 (eight) Type 45 (eight) 

What is 75 (ten) in base eight? 
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Reprinted by permission from 

Management Accounting. Section 1 
Vol. XLVn7 No. 5, January 1966, pp. 38-45 



Matiagemmt Aocountiiig Via 
G)mputer-Assji$tad iBstmcddn 



. my J0E a. CKABnEB,' JB. 

T b& EApm KATK of tedmological 
chmet m the American economy 
haa ttaditionally l>een associated with 
manufacturing processes^ improve* 
ments of products, etc. Educational 
paycholo^uds have recently made me* 
plidt attempts to apply the fruits of 
this technological advimee to teadhing 
situations, including the industry 
programs of training new employees 
and re-educating masting personnel. 

' During the past year the author of 
iHis article has been engaged in a 
^research project the purpose of which 
is to devel <9 an experimmital pro* 
gram for teathing basic management 
accounting through the use cf a 
computer.* 

C!omputer*assisted instruction may 
be characterized as an automated 
' instructional process ;^th the follow* 
ing features: (1) a computer pro* 
gran^ (p a centralized high-speed 
compuj^ which is actually a high* 
speed data, processing net- 

work iof machine components— and 
(3) student stations which are tied 
to the high*^^eed computer. 

The computer must be capable 
accommodating a large number of 
students simtdtaneous1;sr. .^e instruc*,, 



tor, in the traditional sense of the 
w<^ is involved with the program 
in the sense that he may actually 
prepm« it oir improve its use. ' 

The philc:;ophy or h^fpdtheris un- 
derljting smdi a learnmg-teaching 
situatiem is quite "rimple. Firsts in 
view of the present mass of people 
to educated ail teaching cannot be 
done by human beings. Furthermore, 
tiie teacher can emphasize his finer 
points, leaving mai^ procedural as- 
pects to the computer. A brief de* 
scriptioa of the development of a 
basic management accounting course 
for computer presentation is idven 
below. ' 

*The. oTerall project |> entitled **DereIopment 
and Prenmtation of Four Different College 
Courses bjr Computer Teleproeesuu.’' Two major 
pnnwscs of tilts researcli tit (1) to studr the 
. feasibility of phasing compttte^astisted instmetion 

into the instmctipnal profiam pf n laice state 
unirersity . tad (2) to fidd .te^ tiie com p uter- 
assisted instmetion eonrses id. ofBdal edlege 
dasses with typical students and other nomud 
educational parameters. COnrses are hdng dg 
Tclo]^ in engjnemng ccononucs, modem math- 
ematics, audiology and haste management aecoont- 
ing. The project is supported by tbe United 
States Office of Education under the provisions 
of Title yil 4>f the National Defense IMocation 
Act of 1958, Project No. (OE-4-16-010). The 
equipment used is the ISM 1410 computer 
eon^ration at the Thomas Jr. Watson Resoirdi 
. Center, .Yprktowtl Neights, New York. Comple- 
tion date .for the project is .scheduled for June 
30, 1966. I am especially appredative for the 
;efforts expended by Clurles Hugh Smith who 
served as iny graduate assistant during the past 
year and tp Harold Hitkd and Kenned Wodtke, 
. C<Hlirectors of the project 



JOE J. CRAMER, JR., CPA, WUliamspost Cbgpser 1964, 
is AssisUmt Profsssor of A^icotmthg, ColUg* of Bstsmsss 
Admimstration, Tb* Pennsylvgsusi SMo Vmversby, Vtsi-. 
ostfsHy Port, Pa. ' Ho boids a BSui. dogree from Toxas 
SdsAbetm Vmversby msd MJBji, and DHji. Agrees from 
Imduma Utskfersby. Professor^ Cramer is a freguOnt eon^ 
tributor to professioml jostrmds. 
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Cmm Coatent 

The course is » one^term course 
formalljr dassiiied us basic manager* 
meat accounting. As d^^oped for 
computer presentation; certain por- 
tions of ttie have been ex- 

panded by '^uppleinentary Beading 
A ssignm ents/* prepared by the course 
author. 

l%e completed course, as odginally 
programmed for computer presenta- 
tion, consists of the following topics 
(ten cSiapters): 

X Bitroduction to management 
accounting: 

A. The respomdbiHty account- 

ing and dual posting con- 
cepts ill relation to cost 
accuniulation for (a> 
control and (b) income 
measurement permeate 
the entire course: 

B. Ditjtinction between acc- 

ccunting procedures for 
merchandising and man- 
ufacturing fims. 

n. irate cort accounting cyde (acr 
counting for materials, labor 
and overhead.) 

Basic cost accoiuiting systems 
(historical and standard cost- 
ing sscstems): 

Ai Job orddr costing ^ 

B. Process costing 

IV. Ckmtrol of manufactu ring costs 
. (classiUcation of costs as fixed, 
variable and , semi-variable 
for control purposes, apd 
, usdulness of the flexible bud- 
geting technique for control 
of factory overhead costs). 

V, A«KK3Wting dam for busine^ 
decisions (an intn^uction). 

In view of t^ent curriculum 
changes by the accounting depart- 
ment at Penn State, the course author 
plans to expand the above outline to 
indude direct costing and budgeting 
(peripd planning). 

Conree Authnr, 

Stadent and Computer 

The course included in the research 
was prepared by utilizing a special 



author language develcgied by IBM 
computer sdentists at the T. J. 
Watson Research (^ter. The lan- 
guage is not bound by or committed 
to particular teaching method- 
plo^. 

’ A vel^ limited knowledge of com- 
pute is necessary to use this lan- 
guage. Authors implement their own 
instructional techniques or teaddog 
methods as courses are written. 

With the spcKdal language the au- 
thor can indude questions, proUemj^ 

. assignments, correct answi^ incor- 
rect answers, knowledge of results, 
branches, or alterations ip the course 
sequence, etc. The coipne is stored on 
a magnetic disc to which the ccun- 
put^ has selective access to any part 
with a dday of time of less than one 
second. - 

The course is. presented to students 
via an 3DBM 1050 teacumg tc»<nina1. 
This terminal consists ess^tidly of 
a modified dectric iypewnter through 
which the .cpmpuW types out course 
material to a student seated at the 
terminaL Information can also be 
presimted by slide projector and tape 
recorder under control of the .com- 
puter. 

, In ani^ering a question or . prob- 
lem, the student simply ^rpes his 
answer at the terminal , and relays it 
to the central computer which in ti»m 
provides immediate feedback or 
knowledge of results tq the st^!d^^at 
Thus the teaching station is an input- 
output device. The computerized ver- 
don of the course is demonstrated by 
the following illustration of a short 
sequence. In, this case problem, it is 
assumed that the student has; read 
the relevant section of the or 
other assigned readings dealing with 
computation of equivalent units and 
tmit costs. 

Short Aotess Cort FjrobleBi 

Imelda' Ihrocsssing Corporation in- 
curred ,^,000 of production costs 
during , the past month. Materials 
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costing $22,000 were introduced at the 
start of pzocKiaiRg, while conversion 
costs of $18,000 were iucuircd at a 
uniform rate throughout the produc> 
tion cycle. Of the 40,000 units of pro- 
duct started. 38,000 were completed 
and i^OOO were still in process at the 
end of the month averaging one-half 
complete. No inventory was present 
at the beginning of the month. 
NmiJiiisn: 

1. The equivalent units of produc- 
tion for (a) materials, (b) unit 
conversion costs. 

2. The cost of <a) ending work-in- 
process inventory, (b) goods 
manufactured. 

Thb case problem can be either 
typed out to the student iby the com- 
pute or instructions givim directing 
the student to acquire the problem 
£n»n the pei^n in charge of the 
teaching statiom After the student 
has studied the problem he signals 
Ihe^ CKunputer to initiate > the j instruc- 
tiontd sequence whicd^ in effect, tests 
or demonstrates the student's under- 
standing of assigned reading mater- 
ials. 

In the following example, a section 
of the course based on question 1 (a) 
of> ^:ie above problem is presented and 
explained. Notice that bbth main line 
as well as remedial questions or in- 
structions are labeled so that the 
random access feature of the system 
can be implemented. 

"""la; , 1-1,! ' 

rd In the Imelda l^oc^sing Cor- 



poration problem it is assumed 
that no inventory was presmit 
at the be^nning of the month. 
Therefor^ identical rei^ts are 
achieved irrespective , of 
whetiier the average costing or 
first in, first out rnethod is 
emiployed. Nevertheless, use 
the basic framework as set 
forth for average costing in 
order to solve She problem. 
Press (EOB) when you are 
ready to proceed, 
la 1-2 

qu What is fee equivalent units of 
production for materials? 
xl 90 

ty, Try to work faster. , r 
ca 40,000 

cb , 40,000 units ^ 
ty Very good. It is apparent from 
your response thdt you under- 
stand the procedure for calcu- 
lating equivsdent units, 
br 1-3 
wa 3 9,000 
wb 39,000 units 

ty "ifour answer is incorrect. Read 
the problem agahi, imd pay 
, particular attention to the 
manner in which materials are 
introduced. ^ , 

un Try again. Remember that ma- 
terials are introduced at the 
start of processing. ^ 
un ^Perhaps you do not recall the 
definition of an^ equivalent 
unit. Remember that equiva- 
lent usUts must be calciilated 
for each cost element, and you 
are to restate units associated 
with each in terms of com- 
pleted units. 



ExpJatMiUm of la 1-1 ond la 1-2: The computer presents instructions 

to the student in la i-2 and he is told to signal cojngletion after mt^ch 
a question (la U2) is typed out hy the computer* The sUtuent sS then 
given ninety seconds in which to respond. If .an answer w .not entered 
attring this time period,, the computer commaTids the stuwnt.to wwic 
faster. Thus, student responses (including failure to respond) defermiw 
which operaHon codes will be executed by the computer. If the stud^t 
responds by entering' either the c^or the the computer will give the 
' I type out associated with the correct answer and proceed to la 1-3 which 
is the neart ?noin line question in the sequence. If either the wa or wp 
response is given by the student the computer will give the associated 
type out and wait for the student to try again, The course authpr can 
include as rjnany corrett and incorrect answ^s as he wishes. Jn this 
parti6tilair shquente 'the computer would give the first un if the student 
entered a response mt programmed by the course author. If this is done 



, a second' time second nn tocnid be executed and me eiud^ enien a 
remedikd branch. Anumc that the ttudent (fines two unrecoffifized 
responses. The computer would then **braMh** him to la I-^a. 



' br l-2a: 

^ The general procedure for 
cdinputliig equivfdeoit units is 
, biisi^ bn the following for- 
mula: I/nits completed and 
.transferred plus units included 
in ending work' in process in- 
ventory (exnr^ed in terms 
of completed units) equal total 
' ' ’ po^blel^roduction. Deduct be- 
giniung inventory (expressed 
in terms of completed units) 
from total possible piroduction 
in order to determine equiva- 
lent units of |>roduction for 
' the current period. Notice that 
it . may be necessary to make 
separate calculations for ma- 
terials, labor, and factory 
overhead, depending upon 
whether or not th^ items 
are added at a uniform irate 
durmg the production process 
or at tihe start or end of pro- 
cessing, etc. Thus, you should 
read eadht problem caretully. 
Are you now able to determine 
equivalent linits of production 
(in this case materials put into < 
process) for materials by using 
■ ^ '• the above formula? K so, type 
in your answer as adjusted, 
ca 40,000 
cb 40,000 units 
br 1-3 

un This answer is also incorrect. 
'Now consider a step-by-step 
solution, 
br lr2b 
la l-2b 

qu How many units were com- 
'pleteted and transferred dur- 
■ ■ ing the period? 
cn 40,000 
cb < 40,000 linits 
br %4 
ca 38,000 
cb 38,000 units > 
ty Correct. This information is 
given in the problem, 
un The answer is given in the 
problem. Type it in. 



la l-2c 

qu How many (equivalent) units 
of materials were included in 
ending work-in-proc^ inven- 
tory? 
ca 40,000 
cb 40,000 units 
br 1-3 
ca 2,000 
cb 2,000 units 

ty . Very good! You apparently un- 
/ . derstand that all units are 
100% complete with reqpect to 
materials since all materials 
are introduced Of start o| 
procesfing. 

Un Bead the problem again in 
order to deteimine the ^'stage 
of completion** of all units 
with r^pect to materials^ and 
try again. 

un All units are 100% complete 
with respect to materials. Thus 
^uivalent units of materials 
included in ending work in 
process inventory amount to 
2,000. Type in the correct an- 
swer. Take a minUte to make 
a personal note to review 
the procedure for calculating 
, equivalent units. . 
la l-2d 

qu Is the following statement true 
or false: Beginning work in 
process inventory is zero. 
Therefore, equivalent units, 
would be zero for the various 
cost elements, 
ca teue . . 

cb True 

tst Conrect. The answer Is given 
in the problem, 
wa fal^ . 
wb False 

ty Incorrect Type in the correct 
answer; it is given in the 
problem, 
la l-2e 

qu You how have all the neces- 
sary data for calculating equiv- 
alent units for material. Type 
in the answer. 




ca 40,000 qu What is the <^uivalent unite 

cb 40,000 unite of production for conversion 

tjr Correct coete? 

la 1-3 etc.... 

JSxplamtUm of la i-2o, la U2b, la l-2c, Jto l-3d, and la l-2ei The random 
access branching feature of computer-^assisted instruction is demonstrated 
by this seqmnce,. This feature represents a significant advantage, of 
coMputer-dssisted instruction over other ti^s of prowammed instruction. 
For example, given the previous assumption mat the student enters ttoo 
uturecoynteed responses to question la 2-2, he is branched to la 1-Za 
(a remedial question) where a hint is given which presumablg should 
etiable him to answer i3te question from lohich he has been branched. 
Only if the correct answer to la 1-2 or la l-2o is given wilt the student 
proceed to the next moAn tine question {la IrS). If the hint does not 
enable the student to answer the question and he transmits anodter 
incorrect answer, he is brancheid to remedial question l-2b. In order not 
to penalize the student who can answer the main line question by forcing 
hm through the erdire remedial instruction sequence the student is given 
a chance of answeringt either the main line question from which he has 
been branched or the remedial question. If he does the former he is 
branched to the next main tine question in the sequence, whereas, if he 
takes the latter route he is given tTte next remedial question leading up 
to an accumulation of sufficient information which xoill enable him. to 
answer the qucstvm firom which he has been branched. TTius, a student 
who has a thorough understanding of his assignment is able to tooirh 
through a sequence lohich would include fewer questions than the 
student who experiences difficulty. Irrespective of the actual path taken 
by each student, immediate feedback is provided by me computer so that 
, he **knows where he stands/* 

In the ac^mai progr^ the ^ort addition to the above described 
problem abo<^e is expanded to include branching technique, it is now pos- 
beginning ioiventories, both first in, sible to incorporate a conditional 
first out and avaage cost calculations, . branching feature whereby a student 
spoilage calculations, more than one is automatically branched if his (ac- 
producing department, etc., which cumulated) error rate acceeds a 
enables 5ie student to acquire thor- certain predetermined percentage. 



ough exposiire to rdevant procedural The special author language in- 
aspecte of process costing. eludes many other functions and 

As iUuste fkW, the branching tech- operation ^jodes^r-including tape re- 
nique permits the computer to alter corder and slide projector controlled 

the sequence of presenting course by the computer---which facilitste the 

materials biised on responses of each leaminj? process. Space does not 

istudent, thereby recognizing indi- . permit a detailed discussion of these 

vidudl differences. Another advantage items, 
is that the student cannot see the 



information stored, in the computer. ReBctfons 

^Unless the author includes “help” . . 

sequences in the program, the student The following comments are based 
mmt rely on what he has learned, on observations during the fall term 
Each student will get different re- of 1964, 

spouses from the computer based on Fifteen students who were concur- 
H Ms answers to questions, etc. rently enrolled in the ten-week 

laie course author attempts to de- course for college credit volunteered 
velop the program in a '^exible man- to serve as subjects during the fall 
ner to facilitate the learning process term. Portions of five chapters of the 
of Os many students as possible. In program were tested. 
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student fubj^^ts indicated that tiiey 
were initially fucinated \sf com- 
puter^assisted instruction i^d inn* 
pressed by the large degree of student 
Ind^endehce whidi (diaracterizes the 
learnkg dtuation as well as the 
ability to proceed at thdr own pace. 
TioM studrats informed the course 
author that for the first time during 
college that they were able 
to direct meaningfid question to the 
instruc^r, graduate assistant, or in 
class, as a result of reviewing com- 
puter accumulation of studmit records 
wln^ a^jailahle to both stodmt. 
and course author. , 

In ad^tiom student subjects "tx.- 
pressed great satisfaction for having 
been given an opportunity to. partici- 
pate in a reim^pirch project vtith their 
duorooin instructor This type of 
student-teacher association (at the 
larger university) u usually re- 
itficted to the graduate student. 

hiterestmgly miough, the majoritir 
of student subjects indicated that the 
early develcmuiental stage of com- 
puter-assisted Instruction has per- 
mitted a greater degree of student- 
teacher intmracticn, especia% on the 
large college campus. Future implica- 
tions of this aspect of computer- 
. assisted instruction is, of course, a 
separate problem. 

Several sbidente became *1)ored” 
after having worked at the computer 
. fcr a few sessions. Discussions with 
these students revealed the following 
reasons for this situation: Inability 
to proceed at the same pace as format 
classroom assignments due to con- 
straints on computer time and facil- 
ities, and necessity to, in effect, pre- 
pare “two” assignments^ne for 
actual course credit and the Other for 
the research project. Demands' on 
student subjects* time in view of 
enrollment in other courses, thus 
accounts for part of this reaction. 

Some students were ner/ous be- 
cause of. eitposure to a nev/ teaching 
medium or inability to type as pro- 
ficiently as they would have liked, 



coupled witii the mere idea «f hiwing 
to “operate a machine.” Host studemta 
subsequently adjusted to computer- 
assisted instruction if iht7 were per- 
mitted to work alone and if sememe 
was available, in case of “difficulty** 
witii hardware and course eontent. 

Heview of student itecoids alsc re- 
vealed that there was a notkeable 
increase in the emouht of material 
coyer^. (number of lines) as the 
student pn^ressed through the pro- 
gram, and that there was no apparent 
reduction in einrOrs traceable to the 
student and those traceable to the 
hardware. 

Frrbrs traceable ' to the indent 
relate to . general misunderstanding of 
, accoun^g concepts . and procedures 
previously covered in prerequisite 
accounting courses, interpretation of 
Questions, , filing and grammar, 
adthmetie errors, and exposure to 
new accounting conc^ts and pro- 
cedures not readily comprehended 
for the, fl^ time, 

Snors traceable tq the haMware 
(as wdl as the course author), relate 
to the rigid manner in '^hidi student 
responses are matched with those 
included in the computer program, 
failure to anticipate and program 
acceptable answers transmitted by 
student (due to terminolofiy, etc.), 
ana other general errors hi program- 
ming. , , 

In addition, stiidents commented on 
. frustrations resulting from having to 
*Vait** at the terminal for data to be 
transmitted by the computer. , 

Most of the above student reactions 
can be explained by the fact that 
computer-assisted instruction is going 
through the initial research stages. 
During recent months rapid stddes 
have been made in improving the 
special author language so that much 
, more flexibility, is given the computer 
in recognizing alternative student re- 
sponses ,and providing sufficient hhits 
which will reduce student frustra- 
tions in the future. 
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Eb^soieiice of tte Cpene AaAor 

Computer>assii8ted instruction is a 
r^tively new area ot research. Con- 
iiequ^tly, course authors and gradu- 
ate iassistants were, also subject to an 
^'adjustment pjrocess’* and they ex- 
lerienced frustmtions similar to 
of student subjects, , Early exper- 
iences qf the author in developing 
. material ibr the management ac- 
counting course are indicated in the 
foUowing th^ cpnmiei^^^ « 

Original plan: to develop course 
pom classroofn tesct materials. Even 
though a tqct is required for students, 
in the usual das^oom situation all 
. stedents are exposed te a broader 
coverage of the subject matter. 
Henc^ rigid reliance on text mate- 
rials alone would limit severely the 
teaching effectiveness of a computer 
program. 

Course authors can overcome the 
above strait jacket by either pre- 
paring supplementary reading assign- 
ments for student subjects or requir- 
ing library reading assignments. 

To serve the needs of a wide 
student and instructor audience and 
derive benefits from a computerized 
course commensurate with costs asso- 
ciated with ite prepaiution, “canned” 
programs will have to be written in 
a flexible fashion such that pedagogy 
peculiar to individual professors can 
be reflected therein with a minimum 
amount of revision. Computer scien- 
tists have already developed methods 
of storing course materials which will 
permit such flexibility. In other 
words, a well-written course can be 
modifled simply by inserting or delet- 
ing sections based on the discretion 
of the in-charge or supervising pro- 
fessor. Not only can pedagogical 
differences be recognized in this 
manner, but costs associated with 
continuous updating and necessary 
revisions of course materials can be 
held to a minimum. 

Revision of course materials. The 



inteessity for revising scctimis of the 
cpurw implied b;y the preceding dis- 
cussion also iri^ts primarily from 
improvements in the special author 
language and reyieyr of records of 
student errors accumulated, by the 
computer. 

In view of substantial improvement 
and expansion of the author language 
since initiation of the research proj- 
ect, future revisions of , the course 
materials yd]I incorporate, some of 
the more recenfiy perfected operation 
cod^ where appliimbte. The com- 
pleted version of the coturse will also 
include quisles, examinations and 
addifionsd case probioms.^ . ' 

Student records provide indispens- 
able information for revising flow 
charting and block diagramming of 
couicse materials so as !o imiprove 
the interrelationships between course 
materials, computer and students. 
Obviously, the task of levising course 
materials from this tyiH' of informa- 
tion is a continuous ono. These re- 
visions will enable the course author 
to develop materials witi\ sufficient 
generality and flexibility te fit indi- 
vidual requirements of studvmts. 

Teaching of concepts and practical 
applicoHons. An important implica- 
tion of the use of computer-assisted 
instruction, as revealed by pre.^imin- 
ary testing of the managemen\\ ac- 
coimting course by student subjects, 
is that the use of this form of instruc- 
tion is relatively more effective for 
the purpose of teaching procedund 
aspects and practical applicatiom^ 
(approaches to solving problems, 
etc.) as compared with the teaching 
of concepts and theoretical considera- 
tions. For example, computer-assisted 
instruction is not presently developed 
to the stage whereby the equipment 
can handle and process complex 
essay questions and discussions of 
concepts in a manner to reflect 
indi*udual differences of students. 
Distribution of supplementary read- 
ing assignments, referred to earlier, 
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if the method used ia the mimege- by its naijMy CMnpMter-assifttd in- 



ment accounting counie to ov^ome structioii is Intended «s «n aui9tin& 
this possible shortcoming of auto- device. 



!nie fuhue Of c(»nputer-assL^^ undertake imd reectioiis of and 
striictipii will, no doubt, be viewed effects of this new form of Instniction 
wi& great optimism and eager an- on students will be analyzed. No 
ticipatimi due to the present education doubt, c^mtput^-assisted instruction, 
explosion and shortage of facility as even in its development stagei^ has 
weU as the limited funds «vailable to one compelling positive slant: all 
accommodate the required mqpansion teaching simphr cannot be d<»e by 
in educational activities. As indicated human beings! 




processed. 



spects of computer-assisifed instruc- 
tion. For example, cost-benefit ami 
other fimsibiUly studies will be 
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TTherc is agreement betweien mathemati-, 
cians and educators that future wd in- 
service tochers need a good background 
in mathematics subject matter. Tov/ard 
this end many colleges, universities, and 
school systems have developed content 
courses for elementary teachers that are 
very similar to the recommendations of the 
Committee on Undergraduate Program in 
Mathematic^ of the Mathematics Assod- 
atioii of ^erica. 

V7ith the increased press Of enrollments 
in these preseirvice and y-$efvice courses, 
it has become increasin^y diffcult to find 
ihstrurtors who can teach thwe content 
courses in a manner that not only improves 
ths student^s background but also improves 
the studenfs attitude toward mathematics. 
!n Ibis article the authors will explore the 
possibilities of the use of computm’-assisted 
instruc^n in matiliematics courses for ele- 
mentary school teachers and will report 
finding troffi a field trial in which CAI 
was used as the major portion of a college 
math^atics course. To the best of the 
authors’ knowledge, this is the first attempt 
at such a use of CAI. 

Just what is CAI? The name should 
convey the 'incept of a computer’s being 



used as an md in the teaching-learning 
process. Essentially, it is programmed in- 
struction presented under computer con- 
troL 0>urse content is^progranuned 
Cou^writer, a computer langua^ di^vel-.. 
oped by Jutemationa! Business Madges r 
Coiporatiorfs Thomas J. Watsoa Research 
Center. The program is stored and relayed 
by a computer, in this case an IBM WIO 
data-processing system located at the Com- 
putation Center, T^e I’ennsylvania . Stats 
University. Course materials are processed 
over telephone lines for plantation on 
IBM 1050 student terminals— a modified 
electric typewriter, random-access slide pro- 
jector, and tape rjscorder unit. 

Each student relays his response to the 
computer, which evaluates the response, 
provit^es knowledge of results if correct, 
and tiiPii either shows a slide, plays a 
tape, or types out the next question. If 
the answer is an anticipated wrong answer, 
a s^cific clue is provided; and the stuc^ent 
again responds to the question. For uii- 
anticipated wrong answem, the computer 
either types out a scries of clues or the 
reason for the correct answer, or branches 
to a series of smaii-step questions. Course- 
writer allows for partial answer-processing 



on sucli fectors as key words or speUiDg. 
Branching decisions are based on partic- 
ular answers, on an accumulated error 
count, or on student dedsion. 

There are several advantages that have 
been noted for CAI, particularly in com- 
parison witii other programmed devices:* 

1. llic conaputer carefully controls the 

If^rning sequence of each student and re- 
quires the student to comprehend each 
frame. . 

2. The computer can judge constructed 
responses for accuracy. 

3. The computer may olfer a more 
stimulating learning situation than is some- 
times provided by programmed texts.. 

4. The computer can utilize badkgroimd 
information on each student for construct- 
ing learning sequences and judging, re- 
sponses. 

5. The computer is more versatile than 
the programmed text It can teach a wider 
variety of tasks and employ a wider range 
of auxiliary stimulus-presentation equip- 
ment, 

Currently, there is a great deal of 
interest in the use of a guided discovery 
approach to the teaching of mathematics. 
The author of a CAI ^uehce is able to 
use the same type of guided ^estionihg 
that is typical of guided discovery patterns. 
In fact, it has an advant^e over a ginded 
discovery discussion, s^ce each learner 
must respond to each question, experienc- 
ing discovery hiniself. 

7: The cdihputer offers dsUa on the 
entire learning session as well as su m mary 
information These data can be useful in 
revision of a programmed sequence as wOll 
as for school records and research pur- 
poses. Students can use their “type-oUts” 
for study. Also, student records can be 
very usMul in analyrihg the thinking pat- 
terns of atiidents. 




llbay of theie were odbiptea from Walter Dick, 
Deydopmeat ana Current Statua of Computet-Baaed 
Inatruetion,’* American ^dueetione! Reeeareh Journal, 
It (January 196S). 41-^4. 



$. The computer is a long-term invest- 
ment that may be used for a varied of 
purposes, such as data processing. It may 
be loss expensive and less space-consum- 
ing than programmed texts. 

Is CAI an effective means of teaching? 
This is a question that needs thorou^ 
study. The held test report that follows is 
a small piece of the evidence necessary for 
adoption of CAI procedures on a wider 
scale. 

The course used in this study was pro- 
grammed on the basic mathonatics emt- 
tent of Math 200, for freshmen and 
sophomores in the elementary-education 
sequence at PSU.* In addition to the course 
text,* other refcrcnccs. wcre used as content 
guides in writing the program.^ The ma- 
terial was divided into fourte^ chaptos, 
with the following indicative titles: Sets; 
Relations; Exponents; Our Numeratioii 
System; Other Numeration Systems; Whole 
Numbers: Addition, Subtraction, Multi- 
plication, Division; Integers; Rational 
Numbers: Fractions, Decimals, Ratio and 
Per Cent; and Real Numbers. 

The strategy of instruction for the CAI 
movmafh program* uses sevtrial basic as- 



^his course WM devdoped us « portion of "TIm Oe> 
vdopment end Presentation of PocT Diffcrmt Colkct 
Con^ by Computer TdeproceMins.** a. research proj- 
ect ifonded under the prprblons of Part B. Tifla VII 
of tiie National Dufenee Education Act of Iff 8, UA 
Office of Education Project Number OE-18-OlO. Col- 
lege of ^ueatioB. The Pennsylvania State Univentity. 

’'John A. Peterson and Joseph Heshh a hi , Theory of 
Arithmetic (New Vork; John A. WSey A Sons. IHt). 

^Francis J. liudler, Ariikmetie—Ite Strneturo «ni 
Coneepia (Englewood Oiffii,’N. J.: Prenti4e*Hallf lIM). 

Robert L. Swain and Eugene D. NIcbols, Vnieratawi^ 
ing Arithmelk. (New Vbrk; Holt, Rindiart airi ’iHn- 
stbn, ■ jflSB). 

U. Word and C. fi. Hardgrove, Uodem RUmmOtnt 
Mathomatiee (Reading, Uasiut AddisonrWesky . P«ip- 
lishing Co., 1968). , • 

C. Cuthbert Webber and John A. Bkjwji* Batik 
ConeepU of Mathematic* (Rekdlnf, litihi.: A dah J lK 
Wetiey P»*’C:<iilng,.Co., 1968). 

•The tiCe mavmath is formed from ‘‘teodem anttli^ 
maties vrith audiovbual aids”; topee and sU-deo *f 
activated bp the computer. Another vonion, 
usc«‘* book Of displays in place of the topei and dMee. 






^umptioiis Gooceniing the teaching-leamiiig 
procesi.* These aie: 

1. Mathematics is best learned when 
students are encouraged to discover the 
basic ideas, laws, or principles of math- 
ematics. Thus, students should be given a 
diance to stdve a new {noblem rather than 
be shown how to solve it first. 

2. The reason for studying a topic 
should be made clear by the manner in 
Mfhich it is introduced. 

3. ^^Individuals differ in their recep- 
tivity for learning.**’^ 

4. “Effective learning is continuous and 
developmental in nature;”^ thus previous 
generalizations and hicts are helpful in de- 
veloping new generalizations. 

5. ^X^ontinual failure by an individi^ 
at any level makes for infective learn- 
ing.”* 

6. “Active partidpation by the student 
tends to produce an effective learning ex- 
perieneb.”** 

7. “Knowledge of one’s progress con- 
tributes to effective learning,”** 

A belief in these assumptions leads to a 
teaching procedure in wluch the studimt 
bt presented with a problem that can be . 
solved by his use of previous knowledge 
and his thoughtful discovery of the next 
step of knowledge in the suby^ Ttife ap- 
proach can be called an inductive ap- 
proach. A deductive approach is usuaUy 
used in programmed materials. The follow- 
ing contrasts these two approaches: 

iNOuenvg Approach 

Student is presented with problem. 

If problem is solved by student, he is led to 
refine his procedure for solving p.c^lems of this 

type. 



^nd« G. L»ak.ord, Jr., "IrapUcaUont of th« P*y- 
diotocy of ijcamins for the Toochlnic of IfathemUe#," 
Th* Growth o/ Mothemotbsdl Idoor, G^nio* 
(WMhinctoo, D.C.: Notlona! Coundl of taieheMi of 
IfaUiematIcs, 1SB9), pp. 40WO, contain* a more «*• 
teniive Itat of Icamlnc prindpk* for teaeliinK ttathc- 
maties. 
nUi., p. 4U. 

HIM., p. 4t«. 

HbH., i. 4U. 

»im, p. 4M. 
mUL, p. 428. 



Student is ashed to develop a teneralua^a. 

If studost cannot solve p^km, he » asked 
developmental questions which lead to the to* 
lution. 

Student soives a similiur problem. 

^ DiiDucnvE Approach 

Student is presented mth generalization. 
Student is presented with illustrative problems 
in which the process of solutim h eiqplaioed. 

Student applies the generalimtion to solving 
problems. 

The. mavmath program attempts to make 
use of a teaching technique similar to the 
inducrive pattern. One or two questions 
cannot adequately convey this pattern; 
however, the followng sequence from the 
program is included to illustrate the way 
in which the material is programmed fo; 
the computer. The flow chart (ncjtt page) 
depicts the questions and comments in 
graphic form, so that the procedure used by 
the computer may be better visuidized. 

There are approximately one thousand 
questions, wMch every student aiKwered. 
There are also branching questions; the 
number of these answered by each student 
varied. The study did not attempt to con- 
trol the number of questions or time. 

The problem that was explored referred 
to the value of CAI — how does it affect 
the achievement of a group compared with 
die achievement of a group in the tra- 
ditiotied v’'j»ss pattern? 

The population — ^all freshman students 
in the elementary education and special 
education curricula at PSU who w«e 
scheduled for Math 200 daring th? spring 
terin of 196^were assigned to sections, at 
random, by a computw. From the four 
sections, one was selected at random. The 
26 students in the section (all women) 
were pretested with a 40-item test of 
mathematical content developed by tiie 
authors (Kuder-Richardson, Formula 20, 
r = .82); the results were used as a basis 
for selecting ten. matched pairs of stadents. 
One member of each pair was randomly 
assign^ to the CAI-treatment group and 
one to the teacher-treatment group. 

All students in the section met together 
for one standard 75-minute period per 
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week Cor ulscussion that centered on their 
questions in regard to content. Both groups 
used the text Theory of Arithmetic, by 
Peterson and Hasbisaki, and both were 
provided with the same stcidy guides. The 
instructor oC die course was coauthor oC 
the CAl program, and he used the same 
outline for the class as had vbeen used in 
developing the CAI program. Both groups 
were considering the same topics each 
week. As a measure of control on outside- 
of-ciass practice, -the answers to study 
guides were collected. 

The teacher-treatment group met twice 
a week for class periods of 75 minutes 
each, The instructor developed the math- 
ematicai content inductively, to paraSlei 
the premises of th& CAI program. Ibe 
CAl'i'reatment was scheduled for 2V% 
hours per week on the computer, equiv- 
alent to the time spent by the teacher- 
treatment group. Instruction and testing 
occurred y/ithin a standard ten-week term. 

inie^posttest was de;Veioped from a spe- 
cially written 200-item pool prepared by 
the authors. Items were selected from &e 
pool on the basis of balance of content, 
content validity of the item, and indices of 
difficulty and discrimination. The test items 
are divided into three classifications: 
knowledge (30 percent), understanding 
(32 percent), and application (38 per- 
cent). A reliability of .82 (Kuder-Richard- 
son. Formula 20) was found for the 50- 
item posttest. 

The mean of the teacher-treatment group 
on the posttest was 40.9, while the mean 
for the CAI-treatment group was 40.4. By 
inspection, the difference between the 
means does not appear to be statistically 
significant. For the sake of precision, a 
/-test was performed; a / of .07 resulted. 
The null hypothesis that the two groups 
are equal cannot be rejected. 

What implications for the use of CAI 
does a finding of “no significant differ- 
ences” have? In this study, CAI students 
fared as well as students in an unusually 
small class. Thus CAI appears to be a 



feasible tool for teaclung mathematics 
courses for preservice teachers.* 

There are several other facets of de- 
mentary-teacher education in which CAI 
should receive more than cursory examina- 
tion: 

First, CAI could be used as a short 
course for the preservice teacher with an 
extremely good background. This would 
allow that student to learn more math- 
ematics in the time allowed for the study 
of mathematics. 

Seconds CAI has great potential for in- 
service work. At present, the topical pat- 
tern of in-service educafiop. involves after- 
school or evening meetings with an in- 
structor from a nearby college, a faculty 
member from the senior high mathematics 
department, or a fellow teacher or admin- 
istrator who has attended an NSF summer 
institute or a comparable program. 

Several difficulties arise from this type 
of program. 

There is the passiveness of the situation. 
The teacher sits and listens rather than 
actively working on the material. Using 
CAI, the teacher would be actively in- 
volved in learning the content. One doesn’t 
just sit and allow an electric typewriter 
to hum. 

Teachers would not have the resentment 
they sometimes feel when a secondary 
school or college “expert” or a fellow 
teacher tells them what to do. CAI eon- 
tent-instruction would allow the educa- 
tional leader in mathematics to take the 
lead in discussion centered on the imple- 
mentation of good mathematics programs. 

Third, CAI is a good device for studying 
sequencing of mathematical materials and 
teaching methods. It allows for control of 
the teacher factor in research studies of 
the type that ask such questions as, 
“Should multiplication and division be in- 
troduced on the same day?” 

Up to now, a rather positive view of 
CAI has been presented. However, there 
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are soie: questions to be answered con- 
cerning the use of CAI: 

1. Few students have had more than 
one course offered by th^ method; what 
is the reaction to long-term study by CAI? 

2. At the present time, there arc the 
technical difficulties associated with any 
new pfoduct>-can they be solved? Just as 
the television set of 1950 needed repairs 
every few months, the present CAI sys- 
tems have sometimes firerjumit disruptions. 
These problems hbpehilly will be over- 
come with increased experience and use. 

3. Writing CAI mat^ials takes a long 
dme. The authors spent the equivalent of 
two man-years on a course that is approx- 
imately a two semester-hour college course. 
Ways of improving wnting speed ^thoiit 
hurting ^ality must be explored. Thus 
the question, **Can programs be developed 
more efficiently?” needs to be answered. 

4. At the present time CAI is ' expen- 
sive, as are most neu^ly developed devices. 
What will be the cost of widespread use 
of CAI? Only time will tell. However, 
sonie experts contend that the cost will 



be reduced to one dollar per boor on the 
terminal. 

5. The computer may be psychoIpgiMy 
threatening to some students. The per- 
sistent questioning is demanding. Can this 
threat he overcome? Should all students 
take CAI courses? Are there requirements 
for adapting to learning by CAI? 

Will CM be a standard classroom fea- 
ture in the future? If the current interest 
and development is any indication, the 
answer is yes* However, it ht hoped that 
educators will begin to learn 
from the history of other new media. In 
particular, it must be realized that an in- 
novation such as CAl can be neither better 
nor worse than the scholarship r.id crei- 
ativity of Uie persons developing die pro- 
gram allow. If CAI Courses are car^iHy 
developed, the authors feel, CAI Offers 
greater potential than previous innovations 
such as sound film, television, radio, film- 
strips, and conventiohai programmed iii- 
struction. Viffiile the jury is still out» CAI 
effers one of the most Exciting methods of 
studying the teaching-learning process. 
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student-subject matter interface 



^ KENNETH H. WODTKE 
' TkePeaiuylvanidState VhiversUy ' 

Uahrenierl^, Pennsylvania. 

INTRODUCTION 

The problem of communicating knowledge, skills, 
and attitudes to students has concerned educators 
for centuries. Earlier debates centered around the use 
of lecture versus discussion methods, the use of the 
textbook, woritbooks, etc. In general, these earlier 
“media** of instruction were passive di^lay devices 
requiring relatively little response involvement ha 
the part of the learner. Recent advances in communi- 
cations technology have revived ii ;rest in the 
question of the media of instruction and have broad- 
ened the avenues through which the learner may come 
into contact with his subject. In general, the newer 
instructional display and response devices are 
**active** as opposed to earlier more passive media. 
They provide for the adaptation of the instructional 
materials to the characteristics of the individual 
learner as con^'^asted with earlier ^‘static** display 
devices, and requife active 'response involvement by 
the learner in the process of instruction. These de- 
vices allow the learner to interact overtly with his 
subject. 

Paralleling the recent technological dts^velop- 
ments in the area of computers and commuiiications 
systems, there has been an emerging technology of 
learning and instruction. A nW breed of educational 
psychologist h|^ emerged which is dedicated to the 
proposition that education can and should be a science 
and not an art. Armed with the tools of behaviorism 
and operationalism, he critically analyzes complex 
subject mattei^, behayiorally defines and eviiluates 
instructional objectives, systematically arranges In- 
structional experiences to optimize learning, and 
applies theoretical models to the process of instruc- 
tion. It is not surprising that these investigators 
should also address themselves to the problem cf the 
optimization of the inodes of communication used in 
instruction. 

In computer-assisted instruction (CAI) the term 
**studcnt-subject matter interface** describes the 



devices such as two-way typewriter, cathode ray tube, 
slide pivojector, tape recorder, etc., through which 
the student interacts with the subject matter. The 
two major dimensions of the interface are its stimulus 
display capabilities and its response processin,; capa- 
bilities.*" Stimulus display capability refers to the 
varieties of ways that a subject matter can be dis- 
played to a learner through the interface. Response 
processing refers to the variety of student responses 
which can be detected by the interface and pro- 
cessed by a computer. The present paper will examine 
several classes of educational variables which deter- 
mine the characteristics of an effective interface. 
The four categories of educational variables which 
must be considered in the design of the interface 
are the characteristics of the subject matter, the 
characteristics of the learner, the nature of the in- 
structional process, and the objectives of instruction. 

Subject matter characteristics 
Perhaps one of the more obvious factors affecting 
the capabilities which must be avmlable in an in- 
terface is the subject to be taught. Different subjects 
require diffeicnt interface characteristics. The most 
extensive study of the relationships between subject 
matter characteristics and interface requirements 



The stiitiulua display and response proe^mg capatililies of a 
CAI system are f.ot solely dependent on the interface device. 
These capabilities are usually a joint function of both the interface, 
the computer, and the software. The lack an important display or 
response processing feature may be due to a limitation in the in- 
terface device, the computer, the software, or some combination of 
several of these foctors. Regardless of the source of the deficiency 
the net effect on students is the same."The lack of an audio capa- 
bility may be just as serious whether it results from an inadequate 
recording and playback system, a limitation rff the central computer, 
or a lack of available srrftware. The purpose pf this paper is not to 
analyze how the various display ar^ response processing capa- 
bilities may be implemented technolosjcally. This would be a task 
for the engineer and computer scientist. The present paper will be 
concerned with the educational variables which must be considered 
in establishing speciHcations for a student subjeci matter interface. 
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has been made by Gtaser, Ramage, and Lipson.* 
Hiese investigators conducted an extensive analysis 
of the behaviors involved in learning three subjects: 
elementary mathematics, elementary reading, and 
elementary science. The analysis was based on an 
actual survey of instructional programs and curricula 
used in the schools. From this task analysis Glaser 
and his associates were able to draw up a set of 
specifications for an instructional environment to 
teach each of the subjects. A summary of their find- 
ings is shown in Table 1. The table shows the wide 
variety of interface requirements for elementary 
mathematics, reading, and science subjects. Science 
appears to provide the greatest challenge to the 
dcvelopmem of an instructional environment. For 



example, science insUuction often requires the 
visual display of natural phenomena and simulation 
pictures. One can’t help but note the obvious ad- 
vantages of a closed circuit television capability as 
part of the interface for displaying sdentific phenom- 
ena. Science instruction also appears to place rather 
sizable demands on the interface in the area of re- 
sponse processing, thus, there are times when the 
learner may need to manipulate controls, construct 
graphs and figures, etc. ^ * 

Some of the requirements listed in Table I arc 
easier to implement than others. For example, our 
experience at the Penn State CAI Laboratory in- 
dicates that it is a relatively simple matter to provide 
various types of manipulanda for the student at the 



^ ■ Table I ' '■ ‘ ■ 

Stimulus and Response Requirements for tjiq 
InstryctionaT Environment In Elementary 
, Mathematics, Reading, and Science 








MATHEMATICS 


READING 


SCIENCE 


Visual 

Stimulus 


♦Numerals ♦Symbols 
^Drawings ♦Pictures 
♦Words ♦Objects 
♦Meaningful arrays 


♦Pictures 

♦Symbols 

♦Letters 

♦Words 


♦Natural phenomena 
♦pictures and draw- 
ings 

♦Simuluation pictures, 


Auditory 
Stimulus , 


♦Sound patterns 
♦Words (for young 
student^ 


♦Words / 
♦Sounds for 
sy *ols , 


♦Sound phenomena ; 


Tactile 

Stimulus 


Objects far minipu- 
lation 


Letters (for 
young stu- 
dents 


. 7 Natural phenomena- 
friction, heat, 
textures, etc. 


Visual 

Display 

for 

Response 


♦Nimeral ♦Figures 
♦Symbols ♦Objects 
♦Letters and words 
♦Sequential choice 
. display, : , 


♦Letters 
♦Pictures 
♦Words . , ' 


Manipulative eon-, 
trols 

♦Sequential choice 
display. 


Auditory 

Response 

Detection 


Words (for young 
students) 


Phonemes Words 
Names of letters 
Words in context 


Words (for yoang 
students) - 7 


Object 
Display and 
Manipulation 

Symbol and 
Figure Con- 
struction 


Numbers of objects 
Patterns of objects 

Geometric figures 


Letters as objects 
(for young stu- 
-dents) 


.Models and objects 
of science area 

♦Graph construction 
♦Figure construc- 
iion 


Sequential 

Stimuli 


♦Algorithm problems 


♦Reading in con- 
text 


♦cycles 

♦Netural sequences. 
♦Laboratory sequen^s 


Time 

Factor 

Presentation 


♦Patterns in time 


♦Introduction of 
prompts with 
delayed response 


♦Time factor in 
netural phenomena 



From Glaser. R.. Ramage, U. H., and l.ipson, J. !. ye Intetface Beta^jn S tu^^ 
Subject Matter. Learning Research and Development ^ter. University of Httsburg, 
Pittsburgh, Re. , 1964, pp. 177. 

♦Instructional functions which probably can be implemented in a CAI system within the 



foreeeable future. 
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Instructional terminal. One course in audiology 
covering the anatomy of the ear provides the student 
with various plastic models of the ear and the skull. 
The student is taught to identify the anatomical parts 
of the ear both by reference to slides depicting the 
various parts of the auditory system and the actual 
models. 

One conclusion seems evident from an examination 
of Table h Existing interface capabilities cannot 
accommodate all of the requirements of these subject 
matters as they are presently taught in the schools. 
Furthermore, it is doubtful whether some of these 
capabilities (voice detection for example) will be 
feasible in the very near future. This obsepation is 
not surprising in view of the fact that most classroom 
instruction provides a wide variety of experiences for 
the learner. It must be remembered that Gli.ser*s 
analysis represents the total spectrum of instniciional 
experiences and few investigators expect CAI to 
reproduce all aspects of these experiences. The 
rather marked discrepancies between the require- 
ments of Table I, and current interface capabilities 
leemphasizes the widely held view thatjCAl must be 
Supplementary to existing instructional techniques. 
MitzeF has pointed out that one of the most im- 
. portant problems to be solved in the development 
of CAI is the determination of the appropriate **mix’* 
between computer-mediated instruction and com- 
ponents of instruction which are mediated by the 
teacher or by still other means such as educational 
television. It is likely that the nature of the “mix” 
will be determined in part by the kinds of instructional 
experiences which can be efficiently and effectively 
provided by the CAI interface. Those experiences 
which cannot be implemented via CAI must be pro- 
vided by the teacher or by some other means. 

What arp the instfuctipnal functions which can 
feasibly be provided within the next generation of 
CAI systems? T have indicated my own conjec- 
tures with regard to this question by marking with 
. an asterisk those instructional functions listed in 
. Table I which I think can be implemented within a 
CAI system in the foreseeable, future. . 

Work with high school and college level CAI 
courses at Penn State (Mitzd,^ Mitzel and Brandon 
indicates that the level of the subject matter is 
also a critical variable in determining the requirements 
of the interface. Elementary mathematics pres>ents 
one set of interface problems and higher mathematics 
. anpthen • r 

The nature of responses in a mathematics program 
are often such that the course author is willing to 
accept as correct a range of answers. In the course 



of solving a comple.^. maUiematics problem roundmg 
errors may result in minor variations in the numerical 
answer. If the computer is programmed to inquire a 
perfect match of the student’s ansvi'c. with a prestored 
answer, answers which are essentially correct will 
be regarded as incorrect by tke machine. As a solution 
to this problem, IBM^ has developed a “limit func- 
tion’* as part of their Coursewriter language. Limit 
function allows an author to program the computer to 
accept all responses within certairi specified limits 
as correct responses. 

Another problem occurs in attempting to teach 
college mathematics using a typewriter terminal to 
display the course and process student responses. 
Mathematics frequently involves the display c>f rela- 
tively complex equations and symbclic configuratmns 
containing subscripts and Superscripts. The type- 
writer is not efficient in dealing with such materials, 
and may actually interfere with learning when the 
student is confronted with the complex task Of in- 
putting symbolic material. The cathode ray tube 
display niay alleviate this problem to some exteiit, 
but the problem of inputting symbolic material through 
a keyboard still remains. It is noteworthy that even 
the most experienced typists have difficulty iii re- 
producing material containing many symbols and 
equations. IBM attempted tc solve this problem 
by developing a mr* hematics typehead and a key- 
board mask to aid the student in identifying the new 
character set. OUr experience with this device at 
Penh State suggests that it is satisfactory for re- 
latively short responses, but that it does not greatly 
simplify the inputting task for longer symbolic re- 
sponses. IBM’s discontinuation of the mathematics 
typehead for its 1050 communications system sug- 
gests that they may have had similar misgivings con- 
cerning this procedure. 

Mathematics is not the only subject matter which 
presents special problems for the CAI interface. 
Several studies conducted at Penn State (Wodtke 
and Gilman,® Wodtke, Gilman, and Logan®), demon- 
strate that the typewriter is an inefficient interface 
for highly verbal subjects af the college level. When 
identical instructional programs were administered 
on-terminal and off-terminal there was an increase 
in instructional time of 25 per cent in the on-ferminal 
group with no commensurate increase in learning. 
In a second study employing a still more highly verbal 
program, the increase in instructional time was 75 
per cent for the on-terminal group with no significant 
difference in learning when compared to the off- 
terminal group. The largest portion of this time decic 
ment is undoubtedly due to the slow type-out rate of 
the typewriter (approximately 120 words per minute) 
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which is substantially slower than the normal read- 
ing speed of the typical high school or college student* 

In an area cf research where variaticri» in instruc 
lion typioally produce only small gains in student 
achievement, a time loss of 25 per cent represents 
a substantial decrement. The time could be used *o 
give students more practice, instruction on new 
material, or practice or. transfer problems. In addition 
to the gains in student learning which might accrue 
from a more efficient use of intdructional time, there 
are also economic consideratiojis in the cost of com- 
puter dme, tie-lines, and other “hidden'* cqsts in- 
volved in the preparation of courses. AH other things 
being equal, by employing an interface which would 
.decrease jinstimctional time by 25 per cent without 
reducing the amount learned, four students could be 
taught for every three taught by means of a type- 
writer interface. 

From the college student's point of view, learning 
at a typewriter terminal is not self-paced instruction 
since he must slow down his normal rate of work. 
Pacing instruction below a student's optimal rate 
CQuld produce boredom, negativism, and avoidance 
of CAf as an aid to learning. This is pot ari uncommon 
finding when the pace of classroom instruction by the 
lecture inethod is top slovr for the brighter students. 
The advent of the cathode fay tube display device 
should speed up substaniially thf* display of verbal 
infertnation to smdetits. 

The results pbtaitied. yvjth the typewriter interface 
at Penn State are not consistent with the results re- 
ported in seyerai other jfdudies. Grubb and Selfridge*® 
compared the performance of college students taught 
descriptive statistics via jCAl, conventional lectures, 
and programmed text. Those students taught yia 
CAI took one-tenth as long and achieved twice as 
well on the final posttest as did the other two groups! 
These results are so spectacular that they demand 
replication by other investigators. Schiirdak** found 
that students who learned Fortran programming via 
CAl saved 10 per cent in instructional time, and 
performed 10 per cent better than students using a 
standard text or a programmed text. These some>vhat 
more modest results conform more to expectations 
than the phenomenal results reported by Grubb and 
Selfridge. 

The nature of the subject matter is also an important 
determiner of the response processing requirements 
pf an interface device. Relatively simple drill pro- 
grams may not require very extensive response pro 
cessing since most student responses are of the short 
answer .variety. College-Ieyel tutorial and problem- 
. simulation programs will ordinarily require a CAl 
system with partial-answer processing capability. 



Partial answer processing refers to the capability 
of the computer to search a student's response for the 
essential elements of the correct answer; to disregard 
minor character mismatches, spelling, and typing 
errors, to regard or disregard word order in a stu- 
dent's response depetiding on the nature of the prob- 
lem; etc. In one preliminary study, Wodtke’* ex- 
amined the relationship between student performance 
in a CAl mathematics course, and the number of 
times a student entered a correct answer at the ter- 
mimJ which was regarded as incorrect by the com- 
puter because of a minor character mismatch. The 
con'elation between student achievement in the 
course, and the number of mismatched correct 
answers was— .80! Thus, it is quite clear that inade- 
quacies in the computer's ability to detect correct 
answers seriously interferes with student learning. 
It should be poted that detection of correet responses 
is not solely an interface problem, but is also a soft- 
ware problem. The partial answer processing capa- 
bility in, the IBM C/*I system is provided in the 
. author language, 

Learnef characteristics 

The second class cf variables which must be con- 
sidered in the design of an effective student-subject 
matter interface are individual differences among 
the students. The effects of some individual differ- 
ence variables on , the interface are obvious, for 
example, different interface capabilities are required 
for young children as compared to college students or 
adults. Whereas auditory stimulus display capability 
may be “supplementary" at the adult level, it is ab- 
solutely essential in instruction with very young 
children who are still nonreaders. Auditory communi- 
cation would be the primary means of communi- 
cation with nonreading youngsters. Glaser, Ramage, 
and Lipson* point out that auditory response 
would alsc be an essential requirement for an inter- 
face in teaching young students some aspects of math- 
ematics, reading, and science. For exantple, in re- 
viewing an elementary reading curriculum, Glaser 
and his associates point out that the student must 
acquire the following competencies involving an 
oral response; (1) In learning sound-symbol corre- 
spondence, the student is asked to pronounce the 
sounds of individual letters when written m the 
board or to circle or write the appropriate letter when 
its sound is presented, and (2) At all stages the student 
is asked to read aloud stories using the words he has 
learned. It is probable that some instructional func- 
tions such as oral reading which require oral response 
detection will have to be delegated to the teacher, 
with CAl incorporating those functions which arc 
feasible within the present technology. 
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Object mjuiipulation is like4y to be another important 
instructionai experience , for very young pupils, and 
for older students in some subject matters such as 
science. According to Piaget’s’® stage theory of hu- 
man development, children pass through several 
stages of development. Early developmental stages 
are characterized by sensorimotor development ^d 
the manipulation of concrete objects. Later stages are 
characterized by the ability to operate in more ab- 
stract terms. According to this vie,w, the manipula^on 
of concrete objects would be an indispensable part 
of instruction for elementary jchool children. 

Althcugli there, may be mechanical methods for 
providing experience in the manipulation of con- 
crete objects (Glaser, Ramage, and LipsoiP have 
described an electronic manipulatibn board which 
would be capable of detecting tbe identity and place- 
ment of objects located on its surface), within the 
present stage of technology , it would seem more 
efficient to delegate this function to the teacher. 

The CAI interface must provide a maximum 6f 
flexibility in adapting display and response modes 
to differences in student aptitude and past achieve- 
ment. An author should have the capability of ‘Speed- 
ing up or slowing down the flow of information to a 
Student depending on the student’s aptitude or prog- 
ress through the course. The variation in the rate 
of presentation of instruction requires a time-out 
feature (now available oh most CAI systems) which 
enables the author to regain control of the terminal 
in the case of a student whose response latencies 
are excessively long. Without this terminal control, 
it is difficult for an author working through his com- 
puter program to alter the pace of instruction. 

the need for the interface to provide graphics and 
auditory display capabilities ^ also depenas on the 
past experiences and backgrounds of the students. 
The lypical college under^a^uate has high verbal 
ability. CAI for college students can rely heavily 
on communication by means of yerbal material dis- 
played via a typewriter or cathode ray tube. How- 
ever,, if one considers instruction for culturally dis- 
advantaged students or sttidents in vocational and 
technical education programs, much more reliance 
must be placed on relatively nonverbal media of 
instruction. Such students will probably require more 
graphic displays in the form of pictures, diagrams, 
and drawings depicting the concepts of tne course. 
These students may have difficulty thinldng in ab- 
stract verbal terms and may require much mOre actual 
manipulation of the objects of instmetion. In addition, 
the relatively nonverbal student might show consider- 
• able improvement in learning when verbal instruction 
is supplemented with auditory communication. The 



problem of how to communicate concepts to learners 
who are handicapped in verbal commuiiicmtion skills 
is an important problem for reseai'^h with direct 
implications for the design of GAI display devices. 

One learner characteristic which has important 
implicatipps for the determination of the appropriate 
“mix” between computef-mediated and teacher- 
mediated instruction is the student’s need for affec- 
tion, nurturance, and personal contact With a teacher. 
This viable would be particuMy important dur- 
ing the early stages of learning with young children. 

it is Well known that children vary corisiderably in 

their need for affection and contact with a teacher. 
The need seems to be particularly acute in less ma- 
ture youngsters when they are initially confronted 
with the complexities of a difficult learning task, 
increased teacher support and nurtiirahce may be 
required during the early stages Of the development 
of a complex skill such as learning to read. Children 
should be tested prior to instruction so that some 
decision can be made concerning their need for sup- 
port and contact with a teacher. The instructional 
system niust then provide the additional personal 

contact required by a given child. 

The branching and decision-making capabilities 
of the computer are the most unique and potentially 
important characteristics of a CAI system. To the 
writer’s knowledge, all current CAl systems provide 
the ability to store information concerning the 
student’s learning history, arid the ability to make 
decisions to branch tlie student to instructional 
material which is appropriately suited to the partic- 
ular learning history. The decision-making capa- 
bility of most CAI systems is One technological capa- 
bility which far exceeds our present knowledge of 
the process of learning and instruction. Unfortunately, 
psychologists are hard put to , know Which charac- 
teristics of the learner (immediate response history, 
pattern of aptitudes, response latencies, etc.) are 
optimum for branching decisions, and until we dis- 
cover the instructional experiences which are optimal 
for a student with a particular learning history, the 
full power of CAI, for individualizing instruction will 

not be realized. ; 

Characieristics vfike instructional process 

The nature of the instructional process must also 
be considered in the design of a student-subject matter 
interface. It will not be possible in the present paper 
to consider all of the instructional variables which 
may effect the efficiency of an interface; however, 
some of the variables which may have special rele- 
vance to interface design will be considered. 

It is a commonly accepted principle in all theories 
of learning, that there must be contiguity of stimulus 



and response for learning to occur. In common par- 
lance, the principle of contiguity simply meaiia that 
in order for a response to become associated with a 
stimulus, the response must occur either implicitly 
or explicitly in the presence of the stimulus. If a 
student is to learn the English equivalent of a Ger- 
man word, he must reproduce the English word 
(explicitly or implicitly) while attending to the 
German word. Hence, attention to the stimulus word 
or instructional display is a critical factor in instruc- 
tion. It is therefore important to determine the 
charaicteristics of displays which produce a high de- 
gree. of attention on the part of students, Eerhaps 
the most relevant research on this question has oeen 
conducted by Berlyne.’^ Berlyne found that attention 
to a stimulus is heightened by the element of sur- 
prise, change, or noyelty of the stimulus. When the 
same stimuli arc presented in the same format over 
repeated presentations, attention to the task wanes, 
and motivation declines. The effects of novelty on 
behavior can be observed in any student working at 
a CAl terminal for the first time. The novelty of work- 
ing with a machine which “talks back has high at- 
tention holding value, at least during the early stages 
,pf instruction. The interface must be capable of pro- 
yidipg enough variety of stimulation and novelty to 
sustain attention over , an extended period of time. 
An interface which because of limited display and 
response processing capability provides for only 
very simple display ^.nd short answer response 
formats such as the multiple choice frame will soon 

lose interest for the learner. 

Trave.-s*" and his colleagues have recently con- 
ducted an extensive review arid research on various 
aspects of audiovisual information transmission. 
TraversV studies and those of Glaser, Ramage and 
Lipson* must be considered among the primary ref- 
erences in the field uf interface design. Travers has 
re-examined the traditional view that the primary 
advantage of audiovisual presentations is in the 
realism they provide. Contrary to this traditional 
view Travers argues that incrc.ased realism may 
, actually inteifeie, with learning by providing too 
many irrelevant cues, thiis, a simple line drawing may 
be moire effective in communicating essential con- 
cepts to learners than a more realistic picture. Travers 
conciudes: . 

Firsty the evidence points to the conclusion 
that simplification results in improved learnings 
This seems to be generally true regardless of the 
nature of the presentation - whether it is pictorial 
or verbal. This raises interesting problems, for 

the simplification of audiovisual ntaterials is 

they provide a degree of pictorial content will 



generally result in a less realistic presentation 
than a presentation which is close to the Iffe situa^ 
tion. The argument which is commonly given in 
favor of realism which other procedures do not. 

The realism provided may not be entirely an ad- 
vantage and may interfere with the transmittal 
ofirformatioh. The problem of simplifying realis- 
tic situations so that the situations retain informa- 
tion essential for permitting the learner to re- 
spond effectively at some later time to other real- 
istic situations, is an important one!^^ (fp.2.1 10- 

2,ui), ' ' ' , V- " ' 

The limited capacity of a cathode ray tube for 
displaying a high degree of realism may riot be such a 
deficiency after all, 

A more recent experiment suggests that the above 
generalization may have to be qualified in several 
respects. Although simplified displays may facili- 
tate transmission of , information they do not appear 
to faciUtate transfer or application of what has been 
ieaiT^ed as well as more realistic displays. Overing 
and Travers** found that students who were taught 
the principle of refraction of light in water by means 
of realistic demonstrations were better able to apply 
the principle in attempting to hit an underwater target 
than students who were taught by means of simpli- 
fied line drawings. This study suggests that the 
primary advantage of realistic displays may be in 
helping the student to apply what he has learned later 
on in realistic problem solving situations. 

Travers*® and Van Mondfrans and Travers*^ have 
also conducted research , on the relative efficiency 
of information transmission througn the auditory 
or visual senses, or some combination of the two 
senses. In general, their results suggest that in- 
struction involving the viSujd modality is superior 
to auditory instruction when the auditory presentation 
produces some ambiguity in the information trans- 
mitted. Thus, the auditory modality was distinctly 
inferior to all other modality combinations in the 
learning of a list of nonsense syllables, but no differ- 
ences between modalities were obtained when mesn- 
ingful materials were learned. The auditory trans- 
mission of a nonsense term produces considerably 
more ambiguity of interpretation than the auditory 
transmission of a meaningful word. These results 
suggest that the use of the visual modality will be 
particularly effective when the task is to learn new 
associations such as in learning a foreign language. 

Another relevant consideration in interface design 
is the capacity of the human being for processing 
information. Travers*® favors a single channel theory 
of information processing. According to this view. 
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,ihc kum^ 1« c^^lc pf prc>Q^sifi£ infor- 

ina^op t^P^gh oidy chas^l ^ a time, 

aitW^ tbe theory jppstui^e|$, 
inechan^ tiuough w^ch, the ce^iy^f can switch 
&JI11 pne, .^hapn^i to another... Abidingly, it is 
Ipossii^ ^ ovjerioad the hocian inforii^onpipccssing 
.system l^y seeding messages thtppj^ mujltiple sensory 
. cha^ela ^imultan^usly. ,, xon^tipn might 
. re^tljk in g, Iosf ,pf ii^oiroatiop prpcess^ by the 
multi-media CAI intcrfape ^shpuid be cabbie of keep- 
.Jng t^, iF^oidple .moda^^^^ t^s, problem is 

also of concern to the CA! cou^, autltor. who in 



attention to.^the inforomtion pro^ssing. liiniiations 



■-■ n>l-. 



< Another Stream of lesearch in psychology has been 
.conc^^ with , the problcm of imitation or ob^ 

. servational learning. . Bandura, and Walters** have 
demonstrated that^much leaming/sesults from the 
child*s observation, of the behavior of pe^is^ or adult 
- models. Undouht^y, much classroom learning re- 
m SuUs from the. students* observation and rimitation 
of: the behavior of other students andi the teacher 
A whoNserve<as. effective models. Baudum ipd Walters 
: haveraiso demonstrated tiu.: observational learning 
^ occurs as readily^ from iilm^mejiated models as from 
Jive models. These results strongly suggest that an 
'effective, instructional;' environment should provide 
opportunities for students to observe and^mitate the 
I:, performance of models; To provide- adequate op- 
f portunities- . for< .imitative / learnings a ;C Al inteiiace 
WQuW > have,jo provide-a?vidco ^pe, closed circuit 
television or film projection -capability. . Provisions 
Tor observational learning would seem totbe most 
^'valuable in science instructioni iin learning to use 
various pieces of scientific spparapjs oi . measuring 
instrtimenfs, the student could< watch a video taped 
desiohstralion by the teacher s and them practif** 
imilatJng the teacher’s behavior. Ideally; such a sys- 
tem houfd have apiaybacfc feature so that students 
who .^qCiremore vhan one demonstration Cm' have 
the demonstration repeated. Slow motion and stop 
action would also be of value in breaking down the 
components of a complex demonstration so that the 
student can observe the subtleties of the perfor- 
‘ ' mance. '' ■ * - ■ • - • - ^ ■ ■ ■ ■ v; * 

Another important aspect cf the instructional pro- 
cess is that of guidance or prompting of the desi.ted 
respon^. .The intcrfacjemustlc c^^ of, providing 
Juntspr cups, to ih^ Stud^^ when ^ unus^ tong 
; fe$poq$« latency in^c^cs that ,the^ &^ude^t is con* 
or wh^® the .student makpa an oY.eri,^*TP*^* 

. Hints m^y ponsisi pf hij^U^ting the ^rrc'^t i'e* 
sponse in a display by incrci^ing its brightness or 



siK to the other woids in the display. IBM' s 

Cguf^ewfi^er provides a feedback Ihinption which en- 
ables an autimr to p^uvide mies in the form of some xif 
Ihv Iplters in the correct resjpon^ Thus, a student 
who wi^ unable io qame Uie capital city cf New York 
State could be. prompted ^Ih the display: A — y. 
if the student is still unable to prcxiucc the correc t 
response after the first prompt, he could be ^ve i 
still more infonaation in Use seco^id prompt, sUvh as. 
A-h-ny. In addition to the guidance provided by 
prompting, it is also essential that the system pro- 
vide for the gradual witlidrawal of guidance or the 
"fading, of prompts." A prompt should be gradually 
eliminated over a series of practice trials as the 
.- student becomes mOre certain of the correct response. 

Finally, the interface should be caind>le of pros *ding 
. various foims of positive teinforoement or "rewards" 
To student!^ as riiey progress through tl« course. 
Reinforcement may often mketheform of information 
to the student concerning his progress through the 
program; -Reinforcement has tiie effect of sustaining 
motivarion and consequently performance on instruc- 
tional tasks. Perhaps the^ most potentially power- 
Tjul source Of reinforcement in CAMs the degree of 
control which the student can exercise over the 
course of instruction, the extent to which the student 
can select his own menu of instruction, arid the extent 
to which the student can query the computer for in- 
formation. Recent research on prob^m simulation and 
economic games programmed fer computer presenta- 
tion (Ftiirzcig** and Wing*^ suggest that instruction 
involving conversational interaction and iriquiry are 
highly reinforcing to students. Although these in- 
teractive programs place no unusual demands oh the 
stimulus display requirements of the interface, they 
. do extend considerably the requirements for response 
processing;.The interface must be capable of accept- 
ing rather lengthy verbal inputs, the computer 
= mu^t be able to detect key words in a wide variety 
of verbal responses.; ; ^ 

fnstruciionai 

Instructional obJecUves play, an irniwitant tjU in 
deterniining the interface characieristics required in 
ins^ction, U is no great surprise that one of the 
. most succ^sftil early C^AI projects involved in- 
stmetion in v^thmetic d^^ 

Groen**). Aritiimetid ^rili provides a relatively de- 
limited class of instructional stimuli and re$p6n^s. 
The presehtadoh of arithmet^^ problems yh the in- 
leiface presents few^ serious display problems, and 
the rosi^hses ^ that little complex response 
pr^ocessjhg is required. As Sup^s has demonstrated, 
elementary arithmetic Kirills caii ic easily Taught by 
a relatively simple teletype interface, which pro- 
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vides an important adjunct to regular classroom 
instruction. As one be^ns to include other instruc* 
tional objectives such as diagnosis, remediation, 
application, transfer, problem solving skill, atti- 
tude formation and change, etc., one flnds that the 
interface facilities must be broadened consid.$rably 
to provide the enriched variety of expeiicaces needed 
to accomplish these objectives. 



SUMMARY 

The primary purpose of this paper was to illustrate 
the effects of different subjects, different students, 
different learning objectives, and instructional pro- 
, cesses on the functional requirements of the student* 
suii^ct matter interface. Although there is much 
diversity in the experiences which an instructional 
environment must provide to students, these ex- 
periences also have much in common. TTie question 
arises as to whether a single general purpose in- 
structional interface can be developed to teach a wide 
variety of different subject areas. Glaser, Ramage, 
and Lipson^ have addtessed themselves to this 
question. In general, there ?ems to be some con- 
census that the next gece atio? Up-to-dste opera- 
tional CAI system wm have the following capa- 



bilitiest 



(J) Keyboard for response input 

(2) Cathode ray tube display with light pen re- 
sponse capabiuly 

(3) Video tape or closed circuit television capa- 
bility built into the CRT unit 

(4> Random access image projector with positive 
address (may be unnecessary if the system pro- 
vides video tape capability^ 

(5) Random access andio communication device 
with positive address. 

A CAI system with the above capabilities would be 
able to provide many of the educational experiences 
outlinedinTabiel, ' 

tii analysing ciemcmary mathematics, reading, and 
science, Glaser, Ramage, ani Upson* i.ave outlined 
some of the m^ior deficiencies of the general pur- 
pose interface. These specif educational functions 
nay require special, purpose interface d.cviccs which 
will be fearible only in, cxperimehtal C'A! systc.ns 
in the near future. An operational mstnictiond sys- 
tem may have to provide these experiences through 
regular classroom instruction or special laboiatpry ex- 



penences. 

Mqjor deficiencies of a general purpose student 



subject matter interface: 

(1) Mathematics““dbject manipulation to develop 
basic number concepts; the manipulation of 
three dimensional geometric figures, line draw- 
, iqgs,,biscr4ion of angles, drawing perpendic- 



ulars, etc. as in geometry. The “Rand Tablet” 
which currently operative on some experi- 
mental CAI systems provides the graphic re- 
sponse capability required for teaching courses 
in mathematics, science, and hahdWriting. The 
Rand Tablet allows the student to make line 
drawings, graphs, and diagrams Which arc 
simultaneously displayed on a ckthode my tube 
screen, and evaluated for accuracy by the 
computer. The Rand Tablet may be operational 
in future CAI systems. 

(2) Reading-Oral response detecdon for very 
young children. 

(3) 3ciencc-The limitations of the general pprpwc 
interface in the area of science instruction 
depend upon the extent to which actual ex- 
periences with scientific jdicnomeng can be 
simulated. Will student learning of scientific 
concepts be adequate in simulated laboratory 
experiences, or will direct experience with the 
actual phenomena be required? Although a 
number of investigators are presently engaged 
in the development of simuiaied scienci^ labora- 
tory programs for CAI, these programs have not 
as yet been evaluated, thus, we must awmt an 
answef'to the question of the value of simulated 
experiences^ in science. One recent doctoral, 
dissertation completed at Rcnn StUtc has some 
bearing on the issue of simulated versus Mlual 
experience with sdcntificsphenonistta. Brosius*f 

- compared the lemuing effects of watching 
films of Jlhe anatoniy and dissection of the earth- 
wonn, crayfish, perch; and frog in biolr^^al 
science with the experience, of having fire stu- 
dent perform the actual dissections , of the 
animals. Student achievement w(as m^ured in 
terms of . achievement of factual information 
of the anatomy , of thit animals, skill in the per- 
formance of actual dissections, skill in the 
manipulation of scissors,, scalpel,, forceps, and 
probes, and attitude towards science. The 
filmed demonstrations were as effective as 
actual dissection on all measures, except the 
achievement of -factual information in which 
the film mctlwrd was actually su^rior to the 
method involving actual dissection. This study 
suggests that filmed demonstrations may be juit 
as effetliye as direct experience in facilitating 
learning of some concepts in biolojgjcal science. 

Although present technology may be inaddiuate 
to accommodate all instructional applications Out- 
lined in this paper, it is expected that improvements 
in the interface wifi emerge which will closely approxi- 
mate the fequiiiemtnts of many educational tasks. 
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The writer’s general position is that the ruterface 
should **idea]ly” provide as wide a latitude of stimulus 
display and response capabilities as possible to ac- 
commodate a variety of instructional problems. How- 
ever, while we wait for the necessary technolog> to 
emerge much valuable work can be accomplished with 
relatively simple interface devices. As we work 
with first generation equipment we must be especially 
aleFt to Its limltaiions in planning the objectives of 
instruction. Experiences which cannot be adequately 
provided via CIA must be provided by other “off- 
line** methods, such as textbooks, workbooks, educa- 
tional television, laboratories, teacher demonstra- 
tions, and maybe even a lecture or two. 
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CoirilJUter- Assisted Instruction: A Simulated Tutorial Approach * 

Kenneth H. Wodtke 

The purpose of n\y paper today is to describe a research and development 
project in progress at The Pennsylvania State University. The primary objec- 
tive of this project is to test the feasibility of simulating the tutorial 
teaching model in providing college-level instruction under the control of a 
high-speed electronic computer. My presentation is divided into four parts; 
a brief nontechnical d<;scription of the hardware involved j an example from 
one of our courses illustrating one possible tutorial strategy; examples of 
several research problems either presently in progress, or planned for the 
future which we consider of high priority; and finally, several possible 
future applications of tutorial computer-assisted instruction (hereafter re- 
ferred to as CAI) at the college level. 

Description of the Penn State CAI System 

Since April 1964, faculty members at Penn State have been preparing 
courses for presentation to students via an International Business Machines 
7010 computer system. The courses involved are modem mathematics, manage- 
ment accounting, audiology, and engineering economics, at the college level; 
and technical physics, mathematics, and spelling at the two-year post-high 
technical training level = Courses are being prepared by means of a 

^The research described in this report v^as supported in part by Bureau 
of Research, U.S. Office of Education under the provisions of Title VII (B) 
National Defense Education Act of 1958 as amended. 

^Remarks presented at annual meeting of Nationals Society of College 
Teachers of Education, February 17-18, 1966, Conrad Hilton Hotel, Chicago, 
Illinois. 





330 




progranming language known as Coursewri ter developed by IBM computer sclen- 
tists at the Thomas 0. Watson Research Center, Yorktown Heights, New Y6rk. 

Coursewri ter language enables an instructor, with a minimum of special 
training- to develop s CAI course. including questions, problenis, assignments, 
correct answers, incorrect answers, provisions for uniantlcipated answers, 
knowledge, pf rpsuUs,. and branches, or alterations in the instructional sequence 
By means of additional special. codes, the instructor can program the computer , 
to present si idpSr or tape recorded material at the student*? terminal,, and 
can request parti alranswer processing of student answers « This latter, opera- 
tion permits a student to give answers several words in length and Instructs , 
the computer to ignore trivial characters such as commas, periods, spaces, 
differences in. word order, and misspelling if ^^sired. The computer auto- 
matically records and stores all, student responses^ .errors, md response . 
times. The instructor can later obtain a, printjroqt .and, statistical anal^^ 



of these data by means of special Instruction known as Student Records. 
Course material is stored on magnetic discs to whicfi the computer has 






selective access to any part with an access time Of less than one second. A 
course is presented to students via an IBM 1050 communications system Which 
includes a modified IBM electric typewriter, a random access slide prbjdct^^ 
and a tape recorder. Information, questions, or problems cbn be presehted to 
the student either through typewriter type- out, 'slides,' or tapP r^ 

In responding to. a question or problem, the student simply types his ahrver 
on the typewriter and. relays it to the central computer by pressing a button. 
The computer then evaluates the response by comparing it with pre-stored 
criteria for .correct answers, and provides immediate knowledge of results to 
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the student. The student terminals are located on the Penn State campus. Two 
main computers are in current use, one located on the Penn State campus and the 
c*lier at Yorktown Heights, New York. Transmission of information between the 
student and the computer takes place over voice-grade telephone lines by means 

of teleprocessing. 



O ne example of a CAl tutorial program ' " 

Before <leveloping an instructional program based On the tuWial teaching 

model, ft ts fair to ask to what extent do we 'undmtoBO tns tviorTai isoaet* 
Can we identify the relevant characteristics of such a teaching model? What 



are the roost effective tutorial strategies? The sad fdtt is that very little 
is known about the properties of effective tutoHal instruction. What little 



research accomplished on the complex problem of effective instruction has been 
conducted in classroom or group settings. We frankly admit an eclectic ap- 
proach in our early course development in CAl at Penn State. However, it is 
our hope that through experimentation with a variety of strategies, different 
subject matters, and different students, we c^ eventually identify the most 
appropriate instructional strategy for a given student in a given subject 



matter. Our hypotheses with regard to effective tutorial instruction includes 

some of the following general characteristics: 



ly The tutorial system mils t be highly flexible in adapting to ttie abili- 
ties, interest, ^dleacniSt r^*® 

zy the system must have the capability of evaluating student responses 



aiid storing infowation concerning the nature of these responses for use In 
making decisions concerning the sequence of instruction. 



3) The instructional system must be capable of providing imnediate feed- 

back to the student concerning the adequacy of his responses. 

4) The system should utilize a multi-media approach to instruction. 

5) The system should be capable of providing students with the optiwis 
to determine their wn course of instruction. Students should be required to 
take some responsibility in deciding how they are to pvoceed through the 
course, and when they have reached adequate levels of achievement in the sub-: • 
ject matter. The stqdent; should not be a passive participant, subject tp the 
whims of the coaputer psngram, but, should take an active part in insttuctiopal 

decisions. . • *•. •'■■ ■ 

6) The instructional system should be capable of providing variety in the 
form of variations in the media of coiniwnicatipn, vqriations in questions, 

problems, andrthe kinds pf-resppnses a student can make, j . ; 

Although the above list is not meant to be exhaustive, it does illustrate 
some of the chaiucteristics we believe, to, be important in a good tutorial CAI 



program.'-. ^ ^ r 

One of our experimental courses which seems to incorporate a nuntoei; of 

the characteristics hypothesized to be important in tutorial instruction is 

Speech Patholog* and Audiology deyelopec by Professor Bruce M. Siegepthaler 

and Mr. Jeffrey Katzer. Ti. * *^<t part of this, course provide^instructH O" 

the anatomy of the ear. A flow diart illustrating the instructional, strategy 

of the course is shown in Figure 1, Thpse pf you who are interested in a 



live demonstration. of this course should note that on-line demonstrations are 

being given here in Chicago at the Pick-Congress Hotel through noon .Saturday, 
FeblUiaiy 19. -v--- 
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Accc^af\ying the flow chart is ai key whid! explslns mIc various sequen** 
tial steps in the course (see Figure !)• The course consists of three in- 
structional blocks on the outer, middle, and inner ear, and one test block. 

The course sequence is almost identical in each of the instructional blocks. 
The student signs on at the terminal by typing the Word “start” (box 1) and 
then progresses to boxes 2 and 3 representing an introduction to the course 
and an overview of the material on the outer ear. Following the overview, 
the student comes to box 4 representing the first option of the program and 
he is asked, "Do you want to skip the outer ear?” If the student answers 
"yes” he is moved directly to box 10 repiresenting the first step of the middle 
ear subprogram. If the student chooses to complete instruction on the outer 
ear at this time, he types "no” and goes to box 5, the instruction on the 
outer ear. A sample of the dialogue between a student and the computer for 
the outer ear subprogram is shewn in the main body of this report, on page 
Upon completion of instruction on the outer ear, the student encounter^ 
another decision in box 6. This time, however; the decision is not a student 
optica, but a decision of the programmer to examine the student's performance 
on the material just completed. The computer vexamines the record of errors 
for the student, and if 33 per cent or more of his responses on the outer ear 
program were errors , he is branched to remedial material represented by box 
7, If the student made fewer than , 33 per cent errors on the outer ear pro- 
gram he is sent to box 8 where he is given the option to cover the material 
on the outer ear a second time. Box 9 is a decision box required by the 
program to determine whether the student has already been tested on the 
material covered in the outer ear program;' 
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The sequential decision strategy is essentially the same for the middle 
and inner ear blocks with one Interesting new twist. Before the student Is 
given the option to skip the middle ear block in box 13. the program checks 
his performance on the previous block again in box ll. If ttie student's per- 
formance was not iip to (iar (fewer, than 33 per cent errors) he is not given 
the option to skip the second major block of instruction, but he is sent 
directly to be- 14 representing instruction on the middle ear. Thus, hy means 
of tiris strategyi a student is given the option tp skip material only when 

his previous adiievement has met satisfactory standards. 

^ Having been sequenced through the three instructional blocks, the studen: 
now arrives in the test block at box 26. In box 26^. the computer checks its 
memory to determine whether the student skipped the outer ear block. If the 
student skipped the outer ear, he goes to box 27 and is tested on the outer 
ear. Box 28 determines whether his test performance was, adeqpate. If 33 per 
cent or more of his responses are errors, he is automatically branched back., 
to box 5 for instruction on the outer ear. In sudi a case, it is assumed 
that the student misjudged the extent of his knowledge in exercising his or'g 
inal optlan to skip the material on the outer ears however, the checks built 

into the program did not allow him to slip through with insufficient uirder- r 
standing Of the material. A similar decision is made for each block of in- 
struction skipped. The student is tested on the material he skipped. When 
his performance is inadequate, he is branched back for the necessary in- 
struction. After the student has either received instruction or been tested 
on each?btock of material, he arrives at block number 38 where he is per 
mitted to type any questions he may have about the course. These questions 
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can later be obtained by the Instructor when he requests Student Becbr^ for 
his course. 

Obviously there are many different Instructional strategies an instructor 
could have used in prograsnming this material. Although we consider flexibility 
in instructional strategies an advantage of CAI, the researcher interested 
In discovering optimal strategies for different subject matteir^ and different 
students is obviously fsced with a terribly complex research problem, “e hope 
to develop through our research program a set of experimental programs whidi 
illustrate optimal instructional^ strategies for different sub ject matters . and 
for student groups varying in ability, interest, and past adiievement. 



Problems for Research in Computer- Assisted InstructiorL 

I will mention briefly two research areas which we regard as high priority 
areas for research on CAI. First, we are concerned with the effects of computer 
assisted instruction on student motivation over long periods of time. Prelim- 
inary groups of students have reported high levels of motivation and interest, 
however, it is not surprising that a new and novel instructional tool produces 
such positive reactions. How will students react after l^e novelty wears off? 

Related to the question of student motivation is the often reported ob« 
s^i^yation of researchers working with CAI, that students will work at the ter- 
minal for veify long periods of time without interruption. Other investigators 
have referred to this apparent phentmenon as the "pin-ball machine" effect. 

Me are presently conducting an investigation to determine the extent of this 
effect on student attention to the learning task, and on student achievement. 
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Another ^jMestion which may be considered under the general heading of 
student motivation concerns the ways in which simulated tutorial CAl differs 
frpm “live” teacher/pupil tutorial instruction. What educational objectives 
can or cannot be achieved by means of computer-assisted Instruction? One 
study is planned to compare the motivating effects of feedback administered 
solely by the cwnputer* with feedback administered by tbe student *s pwn 
leachtsr in f aw- to- face interaction. Prei1ifiinai:y evidence suggests that the 
effects of the teacher *s presence may depend on other student personality 
variables. Some students report that they like the relatiYe isolation of 
working at the impersonal, terminal t while others say that, they miss opportu- 



nities for interaction with an instructor. 

A second major area of research has to do with the problem of adapting 
instruction to individual differences in learners. Is it possible to bring 
a greater number of students to a satisfactory level of achievement by 
providing the highly individualizeci instruction which is possible with CAI? 

One of our projects at Penn State involves experimentation with CAI in tech- 
nical training programs. This student population typically tends to score 
somewhat lower in verbal aptitude than the average college student. In 
spite of wide variations in the verbal abilities of different student groups, 
our traditional methods of instructidn stiTl rely heavily oh verbal or written 
communication. The typical college instructor has high verbal fluency in his 
area of specialization, and may often make the eiror of assimiing that his 
students can understand his communications. We propose to develop course 
samples for. CAI which attempt to miriimize the language load for students of 
low verbal ability. Such a course might rely heavily on slides and tape 
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recorded comnuni cation. An attempt would be made In preparing the instruct- 
ional f rallies to avoid long, complex constructions, and high word difficulty 
levels. One of the most challenging problems in CAI is the design of in- 
structional programs which adjust instruction to an entire profile of student 
aptitudes. The medium of instruction should be selected so as to avoid a 
leanier’s weaknesses and capitalize on his strengths. 

Applications of Computer- Ass is ted Instruction at the College Level 

Althouvgh opinions of researchers in the area differ considerably as to 
the role which CAI should take in the overall educational process, the general 
consensus ut the Penn State Laboratory is th^t CAI might eventually be used as 
a supplement to regular classroom instruction. In particular we believe that 
CAI will find its most useful early applications in providing special forms of 
instruction to special subgroups of students. For example, college students 
on academic probation might be given supplementary remedial instruction via CAI 
in addition to their regular in-class instruction. In a similar manner 
supplementary enrichment programs might be developed for the highly able 
student who is frequently forced to mark time in the traditional classroom 
setting. We are currently conducting an investigation of the achievement of 
four such groups of college students in CAI. Two groups of students currently 
on academic probation at Penn State but which differ in level of aptitude, one 
group scoring high and the other low on the Scholastic Aptitude Test have been 
locateci. Two other groups currently on the Dean*s list for outstanding aca- 
demic achievement, but differing in items of high and low aptitude have also 
been located. The hope is that we tan lessen the gap in the achievement of 
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these groups by the systeinetic individualized instruction provided by tM» 

It is also corceivable that CAl will find useful applications in de« 
veloping skills for high school drop-puts, retraining the une*nployed, 
providing supplss^rentary repedt^l inst^rcrc^on in basic skills for the culturally 
deprived, and in providing in-service training for various professional 
groups such as teachers, nurses, engineers, etc* 

As you can see, those of us working in this area believe that the computer 
has great potential for accomplishing a variety of educational objectives. 

In long run, the extent to which this potential i^ realized will depend 
on the ingenuity of the instructional programmer, and the ability of the re- 
searcher to provide answers to complex questions concerning the i^yftematic 
design of Instruction. 





357 



or whether there are properties unique to cpe^uter-ijssisted instruction which 
facilitate retention. For example, some writers have talked about what they 
call the "pliHball machine" effect in computer-assisted instruction. This 
phenomenon refers to the apparent tendency of cons>ul»r-asfisted instruction to 
facilitate high levels of attention to the instructional materials for long 
periods of time. These affects may be due to tba novelty of the instructional 
method and may wear off after some tiise. However, the high attention to the 
task may be longlasting resulting from certain properties of tutgriaV interaction 
which students find highly reinforcing. Unfortunately, the tutorial process 
has not been extensively studied in educational research, however-, the hypothesis 
that tutorial Interaction facilitates attention and student motivation resulting 

improved retention would seem tenable* 

An alternative hypothesis is that the rate of forgetting depends almost 
ent’Srely on limits in the; information storage capacities, of the learner, and not 
■ to any great extent on the nature of instructional stimulus or its mode of 
presentation. Itas, one might predict that raising the Mwunt learned in the 
second treatment group of Figure 4 by providing additional instructional time 
would increase the rate of forgetting so tne performance curve would become 
more like that of group one. The old maxim "The more you have laame^, the rore 
you can forget* may operate hers. Howeyar, most experimental research suggests 
that phenomena such as rate of forgetting and transfer depend on factors both 
in the learner’s storage capacity and in the learning task. Questions such as 
this can only be answered through research. The investigation of instructional 
methods which may produce decreases in the rate of forgetting, in addition to 
producing imraases in toe overall level of performance, should be giyen much more 
attention by educational research workers. 
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Some procedures for controlling the amount learned 
in the study of retention 

Direct experimental control of the amounc le arned, A number of procedures 
may be appropriate to control the effects of the amount learned while examining 
retention effects, Underwood (1964) has suggested a tw6*st^ge experimental, 
procedure in which treatment groups ai^ brought to the same level of leainihg 
and then tested for retent1o,i after some time interval. Although this procedure 
seems feasible in experiments using laboratory tasks, it is often Impossible to 
&ring students to, a coMiibn criterion perfoniiance on complex educational tasks* 
Furthermore, bringing subjects to a common criterion means allowing some students 
more trials or more time at the task, thus, confounding the effects of the' tri|at- 

meni wi th time sp^^ * i ^ 

Repeated measures analysis, . The analysis of retention data carr yie!«ted 
as a problem of comparing t(ie rates of forgetting curves, A repeated measures, 

. analysis provides evidence concerning the“ dyeralT effects of the e> 'erimental 
. treatentsi and in addition, provides ttsts for the differences in slopes of the 
forgetti rig curves obtained from the successive posttest measures. Excellent 
descriptions of repeated measures designs have been given elsewhere (Hiner%, 

1962; Grant* 1965), Only a brief description of the application of the design, 
and analysis to the study of retention effects win be given here; 

The v^peated measures design which seems most appropriate for the study 
of diffeKerit,al rates of forgetting is a j/^o-way factorial designwith repeated 
measures on one e^^perimental factor (see Figure 5), Factor A would consist of 
two or experimental treatment comparisons. Factor B, the repeated measures 
factor* would consist of two or mote measures of retention over time, .A 

, / " ^ ‘ ’f 

statistiically significant overall main effect f.r Factor A would indicate that one 




359 



instructional treatment was gaierally superior to another. A statistically 
significant A X B treatment by retention measures interaction would Indicate 
that the slopes of the retention curves in the tjf^atment groups differed. In 
addition, when the number of retention measurv^s is greater than two, a trend 
analysis can be perfonned to determine the shape of xh-^ forgetting curves. 

Grant (1956) has provided an excellent discussion of the application of trend 
analysis in learning experiments Involving repeated n^asurements. 

The repeated measures design used for studies of retention may or may 
not include a pretest measure of the students* knowledge of the subject matter 
to be taught prior to experimental instruction. The decision to use a pretest 
will depend on the extent to which the subject? are familiar with the experi- 
mental learning material. Miner(T962) desenbes a repeated measures analysis 
of covariance design which world be appropriate for a study in which a pretest 
was administered in addition to repeated measures dn one or more experimental 
factors. In this way it would be possible to control 
prior knowledge, the degree of learning, and the rate of forgetting. 

An assumption underlying the use of the repeated measures analysis of 
variance is that of homogeneity of variance and covariance across all levels of 
the repealed measure. Successive measures of performance over time frequently 
produce a variance-covariance matrix of the simplex pattern in which the 
variance decreases in magnitude from the Initial ta final measurements, and in 
which the covariance of adjacent measures is higher than the covariance of 
measures widely separated In time. Where such a varfance-covariance matrix is 
observed, or for any case of heterogeneity of variance-covariance,, Cole and 
Grizzle (1965) have developed an appropriate multivariate analysis of variance 
fbr ‘repeated measurements which does not depend on the usual assumptions. 



The analysis provides tests for all the main effects, interaptions, and trend 
components provid-?d in the usual repeated measurements procedure* 

Change scores. : The problon of studying v^l^ntion of forgetting effects 
in educational experiments is a special case of the more general probl^ of 
measuring behavior change. An investigator interested in mtenti^^ concerned 
with the differential “loss” of subject matter wMch can be attribut- 

ai#le to different jixperimental treatments. In recognising thd need to control 
the amount learned by treatment groups « some investigators have resort^l to 
simple difference scores (e* g.. posttest 1 minvs posttest 2) to measure loss 
over time. However, simple difference spores present many difficulties and 
generally do not provide an adequate measure of change. The disadvantages of 
simple difference scores have been thoroughly dtspussed elsewhere (Bereiter, 1963 
Thorndike, 196&). In general t simple difference sco^s are highly susceptible 
to artifacts due to regression effects^ tend to be much less re^ 
initial or final status scopes,, and are likely to , be highly affpcted by less, than 
ideal metric properties such as the Jack of an equal iptervaj scale. In yiei^ of 
these difficulties^ and in the light of more repent developments In the measure- 
ment of change (Mayo and OuBois* 1963» lord, 1963)^ simple diffet(«nce scores 
would not be recommended as a measure of retention or loss due to forgetting. 

Hewer developments in the measurement of change spgi to offer praise as 
measures^ of gain or loss due to. learning or forgetting. Mayo, 
recommend the use of residual scores in the stu^ of change. The use of residual 
scores helps solve one of the problaiis associated vjifh sim^^^ difference spores. 
Simple difference scores .have, been found, to correlate, negatively witli Initial 
status scores in a niWber ^of investigations. As (1963) poiiHte this 
negative relationship is son^times, due to a, real relationship bebfeen gain and 
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initial status (e. g,, heavy people are more likely to get lighter; lighter 
people are more likely to gain weight), or sometimes due to an artifact of 
errors of measurement. Often an investigator is not interested in the relation- 
ship between initial status and gain but between gain and some other variable 
with initial status held constant. TMs is precisely the problem in a study 
of retention where one wants to relate the degree of loss to an experimental 
treatment with the amount learned during the treatment period held constant. 

Mayo and OuBois (1963) recommend the use of residual posttest scores obtathed 
by parti aling out the effects of initial status. The procedure. is eguivaiert to 
a part-correlation in which residual posttest scores are correlated with 'Other 
variables of interest. When a residual gain score serves as the dependent 
variable in a comparison of experimental treatments the procedure is equivalent 
to an analysis of covariance. Some slight variations in the two procedures 
might occur as a result of using different regressions for obtaining the residual 
scores. The use of analysis of covariance or residual scores Jb measure loss 
Over time seem to have application in studies of retention. ^..However, the!^ are 
some cautions in the use of these procedures to be discussed below under the 

section on analysis of covariance. 

Iha analysis of covariance. One of the most wi dely used analyses in 

studies of change in educational experiments has been the analysis of covaripnce. 
Surprisingly,.however, the analysis of covariance has not been widely used in 
studies of retention oyer time. As mentioned above, the analysis of covariancs 
applied in a study of change Is almost identical to the use of residual gain 
scores. In the retention experiment, the analysis of covariance provides a 
method for controlling the amount learned statistically. 

The application of the analysis of covariance to the study of retention 



362 



involves the use of the inmedtate posttest measure as the covariate and the 
delayed posttest as a dependent varlablCv A test for significance of differences 
on the delayed test with differences on the immediate test held constant can be 
obtained. This application of the analysis of covariance differs from the usual 
application in that the covariate is administered after the experimental treat- 
ment and may be affected by the treatment. In the usual analysis of covariance 
the covariate is administered prior to experimental treatment# The application 
of the analysis of covariance in experiments in which the covariate is affected 
by the experimental treabitent has been discussed in papers by Gourlay (1953)» 
eochrah (1957) i and Smith (1957). 

the writer has been able to find only a few. examples of this use of the 



analysis of covariance in the literature. In an experiment by Prokasy, ?rant, 
and Hlyers (1958), a two-way classification design was employed to test the 
effects of unconditioned stimulus (use) intensity and Intertrial Interval on 
the^^ extent of eyelid conditioning. Three measures of eyelid conditioning were 
obtained for acquisition on day 1# for acquisition on day 2» and for extinction. 

In the analysis of covariance* day 1 acquisition scores were used as the. 
covarfate for testing the day 2 measures, and the day 1 and 2 combined acquisition 



scores were used as the covariate for testing the extinction scores.: Only the 
effects due to USc intensity held up fn the covariance analysis. The intertrial 
interval and Interaction effects were nonsignificant following the analysis of 
covWiance adjus^ni indl^ the effects of intertrail intervaT appear 

to be Concentrated during the eairly acquisition trials. 

In a doctoral dissertation recently completed at Pehn State, Dwyer (1965) 
compared the effects on student learning of several varieties of visual illust- 
rations as a supplement to verbal instruction, the treatments consisted of 
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varying in their clegree of real fstic detail. The research design employed was 
a single factor, pre-pcsttest design, with a second posttest administered as a 
t$n«day retention test. The immediate retention test data were analyzed by 
means of the analysis of covariance with the pretest as the covariate. This 
analysis supported- the conclusion that simpler line drawings and stick figures 
produced achievement superior to that of slides containing more realistic details. 
Table 1 shews the analysis of the delayed retention test data. The left-hand part 
of the table shows the simple analysis of variance with the delayed retention 
measure as the dependent variable. The rightf-hand part of the table shows an 
analysis of covariance on the delayed retention measure yiith the iranediate 
retention measure serving as the cpvariate. A multiple analysis of covariance 
using both the pretest and the immediate retention measures ps covariates could 
also have been used here. The results show a statistically significant F-ratio 
for the analysis of variance dropping to npnsignificanLc in the analysis of 
covariance which adjusts for group differences in the ainount learned as measured 
by the immediate posttest^ Table 2 shows the adjusted means on the isimediate and 
delayed retention measures, and the unadjusted delayed retention test means for 
the four treatment groups* The similarity of the delayed posttpst means when 
adjusted for the effects of the treatments on achievement measured inmediately 
followfing instruction, indicates that the treatments did not appear to differen- 
tiallyi Weet the degree of loss due to forgetting. 

Although the analysis of covariance provides a method for controlling 
statistically the amount learned in studies of retention, the procedure is not 
free from ambiguity of interpretation. For example. Lord (1%5) described a 
paradox in which the use of observed gains and residua] gains resulted in 
contradictory conclusions concerning the comparative growth of two groups on 
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sane variable. This paradox results when the groups to be coopered differ on the 
initial status measure. The analysis of covariance or residual score metiiod 
anticipates regression towards the mean on the second testing. If such movanest 
towards the mean does not occur <e. g.. if the groups show identical observed 
changes from the first to second testings), the adjusted mean difference on the 
second measure following analysis of covariance will show a supertority of 
gain for the initially high group. The initially high group is said to have 
shwn more growth than expected in the face of the tendency of the mean of that 
group to decrease due to regression, while the initially low group showed less 
than the expected amount of growth. Thus, while the observed change scores 
wouid indicate that the groups did not differ in the/ amount of change, ttie 
analysis of covanance would support the conclusion that the initially high 

group exhibited inorO gain Inftially Tow group. 

M..iti«eriate analysis. The analysis of covariance procedure described 
above is closely related to a number of recently developed analytical methods 
designed for the analysis of experiments involving several correlated dependent 
variables. The problem of correlated learning and retention measures is a 
special CMe of the more general problem of correlated dependent variables. 
Correlated dependent variables may also arise from the use of measures such as 
reading adiieveraent. arithmetic achievement, related achievement or aptitude 
subtests, and related personality measures In the same experiment. What 
investigator has not intuitively recognized the redundancy and anfeiguity 
involved in computing ten or twenty "separate" analyses of vartance on as many 
dependent variables which correlate with one another of the Order .50? Some 
investigators, in recognizing the problem pf correlated dependent variables, 
have resorted to factor analysis to reduce the number and redundancy of the 
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vartables pribr to testing hypotheses concerning the Effects of experiswitaJ 
tmtments. Recent deve1o(s»ents In nwHl wrlate methods represent a further 
advance In the analysis of correlated dependant variables (Bock. 1963; Roy. 1958; 
cold and Grizzle, 1965). ln addition, practical applicability of these methods 
has been greatly enhanced by the development of computer programs to carry out 

-the Analyses. ■ 

One multivariate technique seems particularly appropriate to the analysis 
of the effects of experimental treatments on retention measures with the amount 
learned held consfaht. Roy (19585 has developed a step-down multivariate 
analysis (aTso described by Bock, 1963) for use: with a series of correlated 

dependent wiables which can be arranged in order on a eriojl grounds. The 

«»riaMas in a study of learning and retention would seem to 

lu^iCioii vfwi !»•:! 

follow the order in which the measures were obtained following experimental 

"^tmtitent. Roy describes the methods aS' follows^ 

The hypothesis concerning the 

^^the^?hird variable' given the first two variates, and so on. 

(Roy. 1958. p. 1177) 

Applied in an experiment in which a number of successive retention r^asures are 

obtained, the step-down analysis should provide an analysis very similar to that 
used in the frokasyvGrant. and;^^ experiment described above. The 

concerns the effects of the experimental treatment on the posttest 

(or measure of the amount learned); the second test ^ the effects of the 

treatment on the first delayed retention measure, with the effects of the 
ipKsdiate posttest partialed out; tne tmre le.. ..u-ce...- - - 
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treatment on f-e second delayed retention measure with the confined effects of the 
imnediate posttest and the first delayed retention test partialed out, etc. 

The statistical significance of the second and third tests, and any successive 
tests, would indicate that the experimental treatments had differential effecte 
on long tern retention which, were independent of the arount learned. A computer 
program has been developed for this analysis at the Psychometric Laboratory Of the 

Universily of North Carolina {see Bock, 1963), . . : 



Separate Groups Design - *;•' ar. - \ ^ v > ‘ 

One of the difficulties with the successive posttest design discussed ; 

thus far is that the act of taking a pretest, or successive posttests may , 
effect to some extent, a subject's recall of the subject mattpr. Undeiwopd {1957) 
has shown that a swsiantial anXnirit of the foiaettirg obtained 1“ vssbal 
experiments employing repeated measures designs results from the proactive 
interference of previously learned materials, , If the effecte of retesting were 
constar across groups the treatment comparisons would not be confounded, 
however, the absolute amount of ftrgeWng ^ 

from the effects of repeated testing, r lf thd. affects of testing interacted with 
the treatment effect, the retention comparison would be confounded wifh this 

intpractioDo , ; . . 

One design which has been used in studies of caisnunication and peteuasion 

{Hovland, Janis, and Kelley, 1953) and has been discussed by Campbell and 

Stanley {1963), avoids the use of repeated pbsttests. this design employs 

separate randomized groups in a two-way set-up in which one factor 

consists of the experimental treatments, and the other consists of a different 

time delay in the administration of the posttest. A treatment by time-ielay 

interaction indicates the presence of di fferential long-tetm retention effects. 










One recent appllcetfon of this design can be found in, a study by Rilliams and 
levy (19g4), Campbell and Stanley (1963) point out that, although this design 



is comparatively sound, it suffers from the potential invalidity pf effects 
das tp an i nts^ecti on between the treatment and the events pccurH ng during ^e 



retention interval* 



V f [ 



Some problems associated with existing methods for the study of retention 
To some extent,. each of the ntethods for. studyin^^^ 
above suffer two major shortcomings common to much experimentation in psychology 
and eaucation: the lacjk of, equal. interval scales for measuring, learning and 
retention, and the effects of measurement err*or in the dependent variable. 
Measures of change such as those involved in studies cf retention over time are 



likely tv Mp paftivulnrly susceptible to the effect fnequality of scale 
intervals# . Thorndike (1965) has shown that results with difference scores are 



likely. to be particularly distorted by inequality of scale increments of the 
.initial and* final status measures. , Unequal scale units are likely to produce 
variations in difference* scores (or in fprgetting “curves “ based. on t^o posttest 
measures) which are not attributable to treatment effects but to, artifacts 
of the scales^ The possibility of such, effects argues for the, use of several 
successive posttest measures to establish more reliablO ^J^n^d^ in the f pipetting 

curves."' c, 

Ghiselli ( 1964 ) argues that variations in the equality of scale units 

are prooably distributed at random, throughout the range of tha scale in the 
case of most achievanent tests. If this was the case. It would be highly 
improbable that random differences in the equality of intervals would, be mistaken 
for true differences In forgetting. However, where ceiling and floor effects 
exist, the inequality of intervals is not randomly distributed throughout the 
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scale and retention data in the form of change scores or curve slopes will most 
likely be highly distorted. 

As for the problem of the low reliability of measures, it is well known 
that measures of behavior change are typically much less reliable than single 
status scores. Lord (1963) has developed a technique for estimating true 
change for individuals given the reliability of the pre~ and posttest measures. 
Essentially a special application of the correction for attenuation. Lord's 
procedure can be used to obtain a partial correlation between estimated true gMn 
and a third variable of interest with true initial status held constant. Al- 
though Lord's procedure is probably not general izable to the problem of group 
compc.risons, it would be highly desirable to have an estimate of the proportion 
of error variance attributable to measurement error for the dependent variable in 
the typical analysis of variance design. The within variance of an analysis of 
variance design has traditionally been said to consist of two scources o"^ errors 
experimental error and measurement error. An appropriate analytical method should 
include a procedure for reducing the within groups variance by an amount attrib- 
utable to error's or measurement. The remaining variance would constitute expjr- 
imental error variance. Such a procedure would provide far mere precise tests 
of hypotheses concerning the effects of experimental treatments on measured 
change. The analysis would provide an estimation of what the results of an 
experiment would have been had the measures of the dependent variable (e.g., 
change) been perfectly reliable. If an estimate of the reliability of a dee 
pendent variable measure is available in an experiment, there seems to be no 
logical » ,ason for not utilizing this information when performing hypothesis 
tests of the effects of experimental treatments on that variable. Measurement 
errors simply increase the within variance and decreases the sensitivity of the 
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experiment to true effects. One of the problems which still remains cO be solved 
in experimentation on the determinants of behavior change , iJ» develoj-ment of 
anianalysis which takes into account the presence of errors of measurement and 
removes this component of variance from the estimate of experimental error> 

Sumnary , ' ' . 

The purpose of the present paper was to point out certain difficulties in 
the inte. tjretation of retention data in educational experiments, and to suggest 
several established experimental designs which seem appropriate ror the study of 
retention effects. The essential problem in the study of the effects of experi- 
mental treatments on retention over time is that such effects are likely to be 
confounded with the effects of the treatments on the degree of learning. This 
confounding results from the fact that measures of learning or immediate reten- 
tion, and measures of delayed retention are usually highly positively correlated. 
Several research designs are considered some of which provide tesx,s for differ- 
ences in rate of forgetting, and others which provide tests for differences on 
delayed retention measures with immediate retention measures held constant. A 
focus in educational research on variables on instruction which facilitate 
long-term effects such as retention and transfer is advocated. 
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Footnotes 



^This research was conducted as part of a larger project funded by the d.S.^ 

Office of Education, under the Vocational Education Act of 1963, Contract No, 

OE 5-85-074. The author would like to thank Harold E. Hitzel, Milnam Rabinowitz, 
and Lee Dronbach who offered helpful suggestions on a., earlier draft of the 
; paper. 

^For ati excellent discussion of this problem in the context of experiments on 
verbal learning see Underwood, B. J., Degree of learning and the roeasuraffint of 
forgetting. Journal of Verbal Learning and Verbal Behavior , 3; 112-129; April, 

1964. 
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Figure 1. Illustration of a design frequently used to study the effects 
of experimental treatments on retention. 
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Figure 2. Results of hypothetical experiment involving retention data- 
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Figure 3. Results of hypothetical experiment Involving retention data. 
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Results of hypothetical experiment involving retention data. 
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Figure 5 



Repeated Measures Design for the 
Stu(|y of Differential 
Retention Effects 

Factor B (Retention Measure) 
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Table It Analysis of Variance and Covarlancd on the Delayed Total Criterion Retention Test Scores for 
the l^our Treacnient Groups. ; " 
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Adjusted and Unadjusted Treatment Means on the Inmediata 
and Delayed Retention Tests* 



Treatment 


n 


Mean 

Immedi ate 
Retention 
Score 
(Adjusted) 


Mean 

Delayed 

Retention 

Score 

(Unadjusted) 


Mean 

Delayed 

Retention 

Score 

(Adjusted) 


Oral 

Presentation 
(Group I) 


20 


41.00 


46.45 


53.56 


Linear 
Presentation 
(Group II) 


23 


56.09 


61.48 


54.80 


Drawing 
PreBentation 
(Group ni) 


24 


55.42 


56.67 


50.60 


Photographic 
Presentuti on 
(Group IV) 


15 


37.33 


41 .87 


52.33 



*From Dwyer, F. M. Jr. An experimental evaluation of the relative effective- 
ness of selected visual illustrations in teaching science concepts to colitgo 
freshmen. Unpublished Doctoral Dissertation, Pennsylvania State University, 

1965. 
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Appmidix H.7 

SOME PRELIMINARY RESULTS ON THE REACTIONS OF STUDENTS 
TO COMPUTER-ASSISTED INSTRUCTION 



The puipose of the present paper is tnrec fold; to 
describe briefly the characteristics of a conqiuter* 
assisted instructional system (hereafter referred to as 
CA-1) in operation at Pennsylvania State University, to 
report preliminary evidence on the initial reactions of 
a groi^} (tf 47 students to CAI, and to indicate severed 
ciuestions for future research raised b> these initial 
student reactions. 

Description of the CAI System 

Faculty members are preparing four courses for 
presentation to students via an 1410 computer; 
modern mathematics, cost accounting, audiology, and 
engineering economics. Courses are prepared by 
means of an author language known as Coursewriter 
developed loy IBM computer scientists at the T. J. 
Watson Research Center, Yorktown Heights, N.Y.The 
Coursewriter language enables an author, with a min- 
imum of special training, to include questions, prob- 
lems, assignments, corr(jCt answers, incorrect an- 
swers, provisions for unanticipated answers, knowl- 
edge <k results, and branches or alterations in sequence 
in hie course., hi addition, an author can enploy a func- 
tion Called Student Records which vrill record and ac- 
cumulate In storage all student errors and response 
times, Addltltinal operations can call for the presenta- 
tion 0^ a slide or taped material at; the student’s ter- 
minal, and for partial answer processing of student 
answers. This latter operation permits student an- 
swers several words in length and instructs the com- 
puter to ignore trivial ph^^cters such as commas, 
periods, spacer, differences in w'"‘d order, and mis- 
spelling if desired. 

The course is stored on a magnetic disc to which 
the conputer has selective access to any part with an 
access time of less than one second. The course is 
presented to students via an IBM 1050 communica- 
tions system which contains a random-access slide 
projector and a tape-recorder attachment. The teach- 
ing terminal consists of a modified IBM electric type- 
writer throu^ which the con^mter types out course 
material to a student seated at the terminal, hi an- 
swering a question or problem, the student simply 
types Ms answer at the terminal and relays it to the 
central cemputer, which in turn provides knowledge of 
results to the student. The teaching terminal is located 
On the Penn, State campus, while the main conqiuter is 
located at Yorktown Heists, N.Y. Transmission of in- 
formation between the student and the cen^mter takes 
place ever long distance telephone lines by means of 
tel^rocessing. 

Reactions of Students to CAI 

Forty-seven students hav«? conqileted some com- 
puter-assisted instruction at Penn. Slate, Of these, 18 
have worked in audiology, 21 in cost accounting, 7 in 
modern mathematics, and 1 in engineering economics. 
The results fall into three general categories; (a) mean 
student self-reports of reactions to CAI, (b) selected 
correlations 8 moi^ a number of student variables and 
performance in CAI, and (c) inqiressions as obtained 
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from guiding students through the courses and from 
informal interviews with students following their ex- 
perience with CAL The results shoulu be regat'ded as 
tentative and suggestive ofhypotheses for furtiier study 
under M^y controlled conditions. The 47 stiMepm 
were the first pilot groiq) toL ’'ttheCAIcoursesj they 
are not a random sai^le of college students, nor were 
they assigned at . random to the fear courses. Fre- 
quently, the students were used to help ^*debug” the 
courses, and problems were encounteredby the student 
which would not ordinarily occur’ with h finished 
course, in addition, these early results are primarily 
of a correlational and descriptive nature, with &eac- 
Gongianying dlffioidties of determining the nature and 
direction <rf causation, hi spite of the above qualifica- 
tions, there appear to be some meaningful differences 
among the scales of the student-reaction inventory and 
some clusters of intercorrelatlous wnich **^m^e 
sense” and siqjport our subjective is! 5 )res 8 ion 8 . 

Following the first session of CAI each student 
conq^leted a Student Reaction Inventory consisting of a 
number of scales modeled after the Semantic Differen- 
tial (Osgood et al„ 1957), The extremes of each scale 
are defined by pairs bipolar adjeotivea mich as 
good-bad, dull-interesting, tense-rejaxed, etc. Thirty- 
one students conqiieted the reaction inventory (the first 
16 students were taughv prior to the development oi 
tMs device), 

A profile of the mean ratings on 12 .attitude 
scales was constructed for the total groi^, and sep^ 
arately for each course. An examination of the high 
points on the prMiie of student attitudes towards CAI 
indicates, that students found the experience hi^y in- 
teresting, goed, fair, valuable, .and active, and that the 
students reported being able to give the machine more 
attention than a traditional classroom lecture. 

That students react favorably to a new and novel 
instructional technique such as CAI Is reassuring but 
not particidarly surprising. The low points inthepro- 
file of student reactions mhy be Mgreater importance 
in pointing the way to in^irovemenis in the instructional 
system and toward new lnstructiona.1 stratej^es. The 
three lowest points in the profile indicated that , the 
students reported being relatively tense 4 ^„oppo$^d to 
relaxed, flading the program inflexible, and missing 
opportunities for discussion. Fifty-four per cent of the 
sannple reported being * 'slightly tense” during the first 
session of CAI, We have no decisive data at present to 
indicate whether the reported tension hndaposltive or 
negative effect on student aobievement and retention. It 
appears that some students aresimply hi^y motivated 
to do well in the course, while others get flustered, by 
the machinery. 

The student self-reporte aeem to agree witli in- 
formal oteervatlons of students worldng at the termi- 
nal, Some students seem “machine shy** during the 
first hour of instruction, and comments such as **Pm 
afraid Pll do something wrong** or “Pm afraid Pll 
break the machine** are quite common. Students usually 
r^ort being more relaxed at the end of the first ses- 
sion Qi Instruction. These observations have led us to 
consider the need for longer warm-ims or an introduc- 
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tlOD to CAl whlcii would prepare the student for In- 
•trucUon. 

The report of program Infleitibility eeeins lohave 
resulted from the requirements <&nearlier CAlsys* 

tem which required a perfect correci-answer match. 
Answers which, were ^^ntUllj^, correct, Jwt dli^ered 
In some trlrlal character (heequenUy unnoticed the 
student, such as iqtaces, upshifts, anddowuahiits, etc.) 
were judg^. Incorrect 1^* the machine, A computer 
which .will nitiA ignore trivial Ckteractexs such aa com- 
mas, p^ods, spaces, etc. andl correctly evauate . a 
correct filler: Is Judged InflexUde hy studento. These 
reports emphasize ^ need for parthd-answer proc- 
essing in CAI systems, , 

Stadenta also rated dte.machinery as. qiuite*'leflt,** 

This ration, ratees the, question of the rapidity of 
CAl, CAl frequently appears to qualify as an ^^cce 
of massed practice. AlUiougb the system Is in meoiy 
student paced, the iixunediate presen^tion ^,the neid 
question foilQwipg a correct nnswux; paces the student. 

A study Is preseintiyundicrway toi^estigatethe rffecls 
<gf shaient-^ontrofled patises in the presentation of the 
cou:i^* tjnfilled ddays nd^tprovide time for students 
tet propees MorinattOii .and to ridiearae their re- 
Spt^es, and ipl^t especially valuahlefollowing the 

c(^ectl<m of an ei^ , , 

(k^eiation^amo^ Selected Studenl> 

Yariobtes, Beactior^ to CAI, and 
CAtrP^ormance Variables 

A miSsing^iata correlational analysis of a matrix 
of variaMes induding stuident errors, rateofperfcrtti- 
ancc;^ SAT scores, cumulative grade-po&t average, 
Bemreuter ptirsonslity scales administered to all 
entering h^esiisaen a^ Pehn. State, student reactions to 
CAh etc*, was computed. The analysis wasperformed 
fcr> fiiS teSsl grotp, and separately for students in 
aiadldOgy and cost accounting. Keeping in mind the dif- 
ficidlieB of a posteriori •♦data snooping,*’ the writers 
MuinihM the idat^ in an attend to find nonchance, 
iheanlD^ghil clusters of correlation coefficients. The 
results reported below are those which inthe writers* 
fud^jmeiihbeiaed to tiet^ 

Althoh^ tJiere are probably few individuals work- 
ing in CAl who qu^tion the edncational advantages of 
parHd-answer prbeessiig^ somie of the present re- 
sults make^quite cl^ the pwidein of the homnafehed 
correct anst^er froth the Studeht*s viewpoint.' (The 
present data werb Obtained priOi* to the availabili^ 01 
partiai-PiMW^ pMO^sing.) Sn scoring the student’s 
record for err^, it was necessaj^ todiStiiguisKbe- 
twee^ lO^timlfb content’ erro^ arid What were called 
' corrabt answers entered itf^ongformvddch were re- 
gfrded as Incos^i'by ebn^uter. The mOanper 
cent odntoit ‘errors , 611 the student’s total nusa- 
iber of responses for’ all ebursea was 20%, while wO 
mean per ceai ednfset answers entered inwrongform 
was 17%. The cbrrelaticds be^Cstf the two types of 
eriors v^nre Tkssl^b and signi^cant at less than the 
;00i level ifor the totid groap and within each course. 
This correlation rdlects the faetthat the student types 
in die corr^t answer *« wrong form, tries the same 
answer once or more fustfor good measure, and 
then diacart^ his original oorrect answer for an ipcor- 
reot rmgtonss,. thus, makittg acont snt error. Someper- 
^steatstu^^ may la duel i.rigioal correct an- 
swer again and When number (^ questions was 
ttsei ^ tlt^ baSs^for computing the percentage of or-* 
jrors, severai students e^oeded 100%. An additional 
prdbietn is ti»t theseperslstent stodents may bethe 



most adf-sufSclcnt students, and the system Isnopi- 
tivdv rolnfcrcSng self-sufficient behaviors. The fiem- 
reutoi Stability and Self-Sufficiency scales correlated 
Slgnific htty and positively with tkcpercentag© of cor- 
rect answers entered inwrmsg form (.43 and .56, to- 
spectlvely). The manual for the Bemreuter describee 
the measure of acli'-suSiclency as fdSowa: “Persona 
scoring high on this acalepr^ertobe sdtme, rarely ask 
for syn^athy or encoir^-agemeat, and tend to ignore d:e 
adf ice of others, thpao scorl^low dislike solitude and 

mien se^ adrfes a^d ensour^em^t,** 

Althoughi the proWem correct a^ers in wmjg 
form car. ’is minii^ed by sp^iflc instructions to stu- 
dents at the beginning of a course or by icaerslng ad- 
ditional correct answers, some wrcaig-f orm errors re- 
sult from typliig habits and poor punctihiiion, A cor- 
relation of .35 (p=.05) between the number of lines of 
program co/ered by a student per hour and a Punctua- 
tion subtesi score on Penn. State entrance examina- 

tion was obta.ined. Furthermore, a native correlation 
of -.26 approaching significance between Punctuation 
scores and percentage of wroi^-form errors was also 

obtained.. .J ’ . , 

The correlations in .T^e 1 (shown for the total 

groiq) and also for the cost accountinggroup in paren- 
theses) generally indicate that students having lower 
cumulative grade poiqts and scoring jowor on the en- 
trance battery tended to rate tiie course and machine 
as fast, ‘Jhe correlations of several subtesis fronilhc 
Penn. State entrance batterywithpercentage of content 
-errors are su^estlve of a similar negative relation- 
ship, althou^ they are . less consistent. These data are 
inmcatlve a£.,the.lnq)ortance the spood fnctor,* 
suggest that courses tjnq>loylng optlcaial delays, op- 
ticnal review, and optional, remedial ,\^ork would be 
bfsneficial for some students. 
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